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Abstract 


One  of  the  many  needs  of  the  Air  Force  is  advanced  technical  degrees.  These 
degrees  can  be  acquired  in  three  ways:  the  Air  Force  can  directly  recruit  personnel 
with  the  required  degrees;  Air  Force  personnel  can  obtain  them  during  off  duty  time 
from  local  civilian  colleges  near  their  base;  or  the  Air  Force  can  provide  advanced 
academic  degrees  (AADs)  through  the  Air  Force  Institute  of  Technology  (AFIT)  or 
AFIT-sponsored  programs. 

In  1995,  the  AFIT  Commandant  initiated  a  re-engineering  study  to  review  the 
AFIT  mission,  One  of  the  initiatives  of  that  study  was  the  Quota  Allocation  Model 
(QuAM).  The  QuAM  model  is  a  two-phase  mathematical  model  based  on  a  Markov 
process  that  is  used  to  feed  a  linear  optimization.  Outputs  from  the  model  provide  the 
minimum  number  of  officers,  by  grade  and  academic  specialty,  that  must  be  educated 
annually  to  meet  the  needs  and  requirements  of  the  Air  Force  in  each  of  the  Air  Force 
education  codes.  This  thesis  effort  entails;  developing  a  user-friendly  tool;  migrating 
the  model  from  lines  of  FORTRAN  77  code  to  an  Excel  spreadsheet  environment; 
highlighting  the  assumptions  necessitated  by  the  Markov  decision  process;  and  testing 
for  sensitivity  to  variations  in  model  input  parameters  (AAD  requirements,  attrition, 
and  inventory  factors). 


IX 


THE  QUOTA  ALLOCATION  MODEL: 

THE  LINEAR  OPTIMIZATION  OF  A  MARKOV  DECISION  PROCESS 

CHAPTER  I 

STATEMENT  OF  THE  PROBLEM 


INTRODUCTION 

Since  the  dawn  of  industry,  the  human  resource  manager  has  struggled  with 
one  primary  question:  How  many  employees  do  I  need  to  hire  and  train  yearly  to 
meet  the  demands  for  my  product  and  to  turn  a  profit?  The  answer  to  that  question  is 
based  not  just  on  product  demand.  Other  factors  contribute  significantly  to  the 
necessity  of  keeping  a  trained  force,  making  this  one  of  management’s  most  difficult 
questions  to  answer. 

BACKGROUND 

Air  Force  personnel  managers  are  faced  with  many  daunting  tasks.  Each  task 
is  based  on  meeting  the  needs  of  the  Air  Force  in  some  particular  area.  One  of  the 
needs  of  the  Air  Force  is  personnel  with  advanced  degrees  in  many  technical  areas. 
These  degrees  can  be  acquired  in  three  ways:  the  Air  Force  can  directly  recruit 
personnel  with  the  required  degrees;  Air  Force  personnel  can  obtain  them  during  off- 
duty  time  from  local  civilian  colleges  near  their  base;  or  the  Air  Force  can  provide 
advanced  academic  degrees  (AADs)  through  the  Air  Force  Institute  of  Technology 
(AFIT)  or  AFIT-sponsored  programs. 
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AFIT  was  established  to  provide  select  officers  with  specialized  technical 
education  based  on  the  needs  of  the  Air  Force.  It  differs  from  its  civilian  counterparts 
in  that  students  can  be  thoroughly  immersed  in  defense-oriented  research  and 
consultation  projects  (3).  The  process  of  determining  the  number  of  advanced  degree 
quotas,  which  should  be  filled  by  officers,  selecting  officers  to  fill  those  quotas,  and 
educating  the  officers  requires  an  extended  period  of  time  (30  to  48  months).  The 
entire  process,  from  beginning  to  end,  including  time  spent  in  school  takes 
approximately  30  months  to  produce  personnel  with  a  required  masters  (MS)  degree 
and  48  months  to  produce  personnel  with  a  required  doctoral  degree  (PhD).  This 
extended  time  period  makes  accurate  forecasting  of  required  numbers  of  personnel  to 
be  selected  to  attend  school  and  receive  AADs  essential. 

The  current  process  begins  with  a  call  for  quota  from  Headquarters  Air  Force 
Personnel  to  the  Academic  Specialty  Monitors  (ASMs).  The  ASM  is  the  key  link 
between  the  Major  Commands  (MAJCOMs)  and  the  Air  Force  Education 
Requirements  Board  (AFERB)  which  prepares  quota  allocations  for  AADs.  ASMs 
are  also  tasked  to  represent  the  Air  Force-wide  functional  perspective  for  degree 
requirements  and  for  the  collection  and  tracking  of  information  for  their  designated 
degree  area  (15). 

The  annual  quota-call  is  the  signal  for  the  ASMs  to  collect  requests  from 
organizational  users,  to  review,  validate,  and  compile  the  information,  and  to  present 
it  to  the  AFERB  (15).  The  AFERB  then  determines  requirements  for  AADs  by 
education  code  and  forwards  them  to  the  Air  Force  Personnel  Center  (AFPC).  AFPC, 
working  with  AFIT,  is  then  tasked  with  filling  the  student  positions  with  qualified 
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personnel  that  meet  the  entrance  standards  of  AFIT,  as  well  as  the  specific 
requirements  for  the  individual  degree  program. 

This  system  is  constrained  by  the  Air  Force  in  that  there  is  not  an  unlimited 
level  of  resources  that  can  be  used  for  education.  The  Air  Force  annually  allocates 
education  resources  based  on  a  set  number  of  man-years  for  education.  Each  MS 
degree  requires  1.5  man-years  and  each  PhD  requires  3.0  man-years.  Therefore,  if 
1,000  man-years  were  allotted,  the  Air  Force  could  send  666  personnel  to  get  MS 
degrees,  or  333  personnel  to  get  PhD  degrees,  or  some  combination  of  the  two  (e  g., 
450  for  MS  and  108  for  PhD). 

The  current  system  has  several  inherent  problems.  The  system  is  totally 
dependent  upon  the  ASM,  the  users,  and  the  personnel  community  to  adequately 
forecast  the  requirements  and  needs  of  the  Air  Force  three  and  four  years  into  the 
future.  The  result  of  this  process  is  that  often,  too  few  people  are  sent  to  school 
resulting  in  Air  Force  needs  going  unfilled  by  way  of  unmanned  AAD  billets. 

A  shrinking  education  budget  and  changing  attitudes  toward  formal  military 
funded  education  have  not  eliminated  the  Air  Force’s  need  for  AADs.  The  education 
community,  however,  has  attempted  to  adjust  its  programs  and  size  to  respond  to  that 
ever-changing  environment.  In  1995,  the  AFIT  Commandant  initiated  a  re¬ 
engineering  study  to  review  the  AFIT  mission.  One  of  the  initiatives  of  that  study 
was  to  develop  a  quantitative  conversion  of  Air  Force  personnel  requirements  into 
annual  flows  of  educational  program  entries  (3).  The  result  of  this  initiative  was  the 
Quota  Allocation  Model  (QuAM)  which  is  a  Markov  decision  model  that  feeds  a 
linear  program  to  provide  minimum  annual  flow  levels  to  meet  the  needs  and 
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requirements  of  the  Air  Force  for  each  of  the  Air  Force  academic  specialty  codes. 

The  QuAM  model  is  the  launching  point  for  this  research. 

THE  PROBLEM  and  RESEARCH  APPROACH 

The  QuAM  model  is  a  two-phase  mathematical  model  based  on  a  Markov 
decision  process  that  is  used  to  feed  a  linear  optimization.  Outputs  from  the  model 
provide  the  minimum  number  of  officers,  by  grade  and  academic  specialty,  who  must 
be  educated  annually  to  fill  validated  AAD  billets.  Inputs  to  the  model  include 
required  AAD  billets,  by  rank  and  degree  level  for  each  Air  Force  education  code, 
and  attrition  rates,  based  on  longevity  and  degree  level,  and  obtained  from  AFPC 
historical  data  (2).  The  model  was  originally  developed  to  meet  the  specific 
objectives  of  the  AFIT  initiative,  and  was  coded  in  FORTRAN  77  with  little  or  no 
documentation  (7).  This  research  focuses  on  the  QuAM  model  and  entails  creating 
a  user-friendly  tool.  Emphasis  is  placed  on  documentation  of  the  model  and  its 
assumptions,  verification  and  validation  of  the  model,  and  enhancing  the  model’s 
flexibility  and  adoptability. 

Specifically,  for  ease  of  use,  the  model  is  documented  and  transported  from 
FORTRAN  77  code  to  an  Excel  spreadsheet  environment.  The  assumptions 
necessitated  by  the  Markov  decision  process  are  discussed  and  validated  to  provide  a 
baseline  understanding  of  how  the  model  should  be  implemented.  Finally,  the  model 
is  tested  for  sensitivity  to  variations  in  its  three  input  factors:  AAD  requirements, 
attrition,  and  inventory  factor.  This  sensitivity  analysis  provides  insight  into  the  input 
factors,  and  how  they  affect  the  model  output. 
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When  completed,  this  research  should  provide  a  user-friendly  product  that  is 
ready  for  use  by  Air  Force  personnel  managers.  This  tool  should  identify  the 
minimum  number  of  officers  that  should  be  educated  yearly,  in  each  education  code, 
to  meet  the  needs  of  the  Air  Force. 

OVERVIEW  OF  SUBSEQUENT  CHAPTERS 

Chapter  II  contains  a  review  of  the  published  literature  dealing  with  personnel 
models  and  Markov  decision  processes.  Other  areas  of  review  deal  with 
mathematical  model  verification  and  validation,  concentrating  on  the  area  of 
sensitivity  analysis.  A  quick  review  of  Excel  Solver  ’97  is  also  included. 

Chapter  III  describes  the  methodology  developed  to  transport  the  QuAM 
(originally  called  EDFLOW)  FORTRAN  77  model  to  an  Excel  spreadsheet 
environment.  The  design  of  experiment  developed  to  test  for  model  sensitivity  to 
changes  in  input  factors  is  also  presented  along  with  a  methodology  on  regression 
analysis. 

Chapter  IV  is  a  discussion  of  the  results  of  this  research.  The  spreadsheet 
model  is  verified  with  the  original  FORTRAN  model.  The  results  of  the  sensitivity 
analysis  are  also  presented.  Chapter  V  concludes  the  research  and  provides 
recommendations  for  implementation  and  further  study. 
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CHAPTER  II 


LITERATURE  REVIEW 


INTRODUCTION 

This  thesis  effort  is  centered  on  the  use  of  the  Markovian  decision  process  in 
personnel  modeling.  The  application  of  this  process  to  personnel  modeling  is 
prevalent  in  the  relevant  literature.  This  chapter  briefly  reviews  some  of  the  literature 
pertinent  to  personnel  modeling.  Dietz’s  EDFLOW  model  is  also  reviewed,  along 
with  discussions  on  sensitivity  analysis,  experimental  design,  and  Excel  ’97  Solver. 


PERSONNEL  MODELS 

In  the  early  1970s,  the  RAND  Corporation  proposed  that  the  military 
personnel  system  was  a  close  analogy  to  an  actuarial,  birth/death  model  of  life 
expectancy  (13).  Entry  into  the  military  is  like  birth  and  is  made  at  specific  low-level 
entry  points  in  the  hierarchy.  All  new  recruits  are  essentially  undifferentiated,  with 
specialization  occurring  as  a  result  of  training  and  experience.  Death,  of  course,  is 
represented  through  the  many  forms  of  attrition.  People  leave  the  military  for  many 
reasons.  Some  leave  voluntarily  after  serving  their  commitment,  others  are  not 
promoted  and  are  forced  to  leave,  while  a  few  actually  make  a  career  of  the  military 
and  retire.  This  birth/death  process  is  the  basis  for  the  Markovian  decision  process. 

In  a  Markov  chain,  an  entity  can  exist  in  only  one  state  at  any  instant  of  time. 
Military  members  enter  the  chain  in  the  same  state  and  then  progress  independently 
from  state  to  state  as  determined  by  years  of  service,  promotions,  and  training  gained. 
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Members  are  then  eliminated  from  the  chain  in  different  states  and  are  replaced  by 
new  entnes  at  the  initial  state.  This  thus  provides  a  sense  of  flow  through  the  system. 

In  the  military,  the  flow  of  personnel  can  be  thought  of  as  movement  from 
categoiy  (grade,  years  of  service,  specialty)  to  categoiy  (13).  In  a  Markov  process, 
there  must  be  definition  of  a  meaningful  subset  of  the  population  (states)  from  and 
into  which  all  movement  occurs  with  statistical  regularity.  In  a  state,  all  members  of 
that  state  are  differentiated  from  all  other  members  on  the  basis  of  one  or  more 
characteristics.  Air  Force  personnel  can  transition  from  grade  to  grade  as  they 
transition  from  year  to  year,  or  they  can  remain  in  the  same  grade  year  after  year. 

In  1974,  Brothers  proposed  a  Markov  methodology  that  could  be  used  as  an 
aid  to  determine  the  force  structure  of  the  military  (1).  His  work  highlighted  the  fact 
that  a  Markovian  model  is  capable  of  providing  for  the  many  tradeoffs  and  different 
controls  available  to  the  managers  of  the  system.  He  emphasized  a  greater 
understanding  of  the  use  of  controls  such  as  recruitment,  promotion,  and  attrition.  He 
concluded  that  stability  in  the  system  and  orderly  progression  could  only  be 

accomplished  through  proper  forecasting  and  through  the  establishment  of  accurate 
manpower  requirements. 

In  1 982,  Rish  proposed  a  model  to  fill  AAD  requirements  for  the  Civil 

Engineering  career  field  (20).  Although  not  Markovian  in  nature,  this  methodology 

provided  valuable  insight  into  the  Air  Force  personnel  system.  He  noted; 

The  Air  Force  is  largely  a  closed  system,  promoting  from  within  their  ranks 
and  ^oviding  almost  no  lateral  entry  into  senior  levels.  Advanced  education 
tor  officers  can  be  obtained  only  by  providing  opportunities  for  mid-career 
educa.tion  or  by  raising  the  educational  and  age  requirements  for  entrance  to 
the  Air  Force  to  unrealistic  and  undesirable  levels  (20:8). 
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Personnel  models  can  also  be  considered  inventory  control  models,  Fu  and 
Hu’s  methodology  on  capacitated  production/inventory  models  (8)  can  be 
incorporated  into  the  Markov  decision  process.  They  note  that  when  dealing  with  any 
production  process,  tradeoffs  must  be  made  between  producing  too  much,  leading  to 
excessive  inventory,  and  producing  too  little,  leaving  the  system  unable  to  meet 
demand.  Their  flow  control  methodology  with  hedging  point  has  an  underlying 
Markov  process.  Fu  and  Hu  note  that  in  systems  where  the  inventory  is  monitored 
continuously  and  where  the  production  rate  is  also  controlled  continuously,  “the 
optimal  policy  can  be  characterized  by  a  single  parameter  called  the  hedging  point” 
(8;  1 5).  The  hedging  point  parameter  is  Z.  In  a  flow  control  problem,  if  the  inventory 
is  less  than  Z,  produce  at  the  maximum  rate.  If  inventory  equals  Z,  then  produce  at 
the  demand  rate.  Finally,  if  inventory  is  greater  than  Z,  produce  zero.  Using  the 
assumption  of  steady-state  in  the  Air  Force,  or  that  inventory  equals  demand,  Fu  and 
Hu’s  methodology  would  suggest  that  the  Air  Force  produce  at  the  demand  rate.  In 
other  words,  the  Air  Force  needs  to  produce  just  enough  AADs  each  year  to  fill  the 
billets  that  will  open  each  year. 

Homestay  takes  a  more  modem  approach  to  the  personnel  problem  (10).  He 
advocates  effort  in  three  strategic  areas:  organizing  and  aligning  requirements  around 
mission  needs;  finding  the  right  person  for  the  right  job  at  the  right  time;  and 
improved  approaches  to  making  employee  performance  count.  His  emphasis  is  to 
keep  personnel  from  leaving  the  system  at  unscheduled  points. 
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THE  EDFLOW  MODEL 


In  1996,  Dietz  proposed  a  methodology  based  on  a  Markov  decision  process 
that  was  used  to  feed  a  linear  optimization  model  (3).  This  methodology  was 
intended  to  provide  the  minimum  number  of  officers,  by  grade  and  academic 
specialty  that  must  be  educated  yearly  to  fill  validated  AAD  billets.  The 
mathematical  formulation  of  this  methodology  is  summarized  below: 

Parameters 

=  attrition  probability  for  officers  with  /  years  of  service  and  degree  level  d 
Rd,g  =  requirement  for  officers  with  degree  level  d  and  grade  g 
Yd  =  inventory  factor  for  degree  level  d  (desired  ratio  of  inventory  to 
authorized  positions) 

Variables 

Xi,k=  number  of  officers  with  i  years  of  service  and  k  years  graduate  education 
(no  action  taken) 

x\k=  number  of  officers  with  i  years  of  service  and  k  years  graduate 
education  (sent  to  school) 

Indices 

i  =  0,...,23 

d=0,  1,2(BS,  MS,  PhD) 
g  =  2,  3, 4, 5,  6  (Lt,  Capt,  Maj,  Lt  Col,  Col) 

A:  =  0, 1, 2, 3, 4,  5  (A  represents  the  number  of  years  of  advanced  academic 
education,  i.e.,,0  =  BS,  1  =  MS  student,  2  =  MS,  3  and  4  =  PhD  student,  and  5 
=  PhD) 


9 


Linear  Program 

The  objective  of  this  LP  is  to  minimize  the  number  of  personnel  sent  to  school 

to  obtain  both  MS  and  PhD  degrees.  This  objective  function  is  this. 

21  20 

Minimize  £x',,o  +  2Zjc',,2  (2-1) 

1=0  1=2 


Subject  to: 

a.  Global  Balance  Constraints  -  Ensure  that  the  rate  of  transition  out  of  any 
state  equals  the  rate  of  transition  into  that  state  from  all  other  states  (3:75),  and 
that  the  number  that  start  must  equal  the  number  attrited  plus  the  number  not 
attrited.  There  is  one  global  balance  constraint  for  each  decision  variable  (125 


total  global  balance  constraints). 

22  22 

Xo,o  X  0,0  Oi.O  Xi,0  ^^23,0  ^ 

1=1  i=2 

•^1,0  .^Vo  ~  -^0,0 

Xj,o  +  x'j,o  =  (1  -  a;_i,o)  X;-i,o 

Xy.O  =  (l-<3ry-l.o).Xy-l,o 
X j,\  ~  x'j-i,o 
Xia  +  x'2,2  =  Xi.i 

Xj,2 + x'j,2  =  (1  -  aj-u)Xj.i,2  +  .Xy-,,1 

X j,2  “  (1  ~  y-1,1) Xj-l,2  X y-1,1 

Xj,3  =  X'j-l,2 

Xj\4  ~  X;-l,3 
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Ji:23,2  S  (7j,2  Xi,$  +  X23,5 

i=5 

(2-2) 

(2-3) 

7  =  2,..., 21 

(2-4) 

7  =  22,  23 

(2-5) 

7=1,..., 22 

(2-6) 

(2-7) 

II 

ts) 

0 

(2-8) 

7  =  21,..., 23 

(2-9) 

7  =  3,..., 21 

(2-10) 

7  =  4,..., 22 

(2-11) 

10 


11 


(2-24) 
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Ex, 5^ 


Rl,^Y 2 


15 


'Lxi,i  ^  RiaYi 
1=11 


(2-25) 


S*. 

z=16 


(2-26) 


23 


Ex,.5^i?2,6/2 

i=20 


(2-27) 


c.  Non-negativity  Constraints  -  Ensure  that  all  variables  are  non-negative. 

Xi,kX\,k-^'^i,k  (2-28) 


The  Markov  decision  process  incorporated  by  the  EDFLOW  model  requires 
that  several  key  assumptions  be  made  (3:76;  2); 

1.  Personnel  within  an  academic  specialty  are  statistically  identical  and 
behave  independently. 

2.  The  average  size  and  distribution  of  the  overall  population  within  a 
specialty  remains  constant. 

3.  Future  attrition  probabilities  are  determined  by  current  longevity  and 
degree  level. 

4.  All  graduate  programs  are  completed  successfully,  i.e.,  100%  graduation 
rate. 

5.  Only  educationally  qualified  personnel  with  appropriate  rank  and  longevity 
can  satisfy  grade  requirements. 

6.  AFPC  is  100%  effective  in  assigning  personnel  with  AADs  to  appropriate 
billets. 

7.  Degrees  are  always  valid  once  obtained. 

8.  All  model  parameters  are  assumed  to  be  constant. 


SENSITIVITY  ANALYSIS 

Once  a  model  is  built,  it  is  necessary  to  analyze  the  results  received.  Jackson, 
Boggs,  Nash,  and  Powell  suggest  that  it  is  necessary  to  do  more  to  analyze 
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computational  results  than  report  solution  times  (1 1).  They  recommend  the  use  of 
statistical  analysis  and  considering  the  statistical  nature  of  the  problem.  Even  with 
few  results,  it  is  suggested  that  statistical  analysis  can  provide  useful  insights  and  put 
the  results  and  performance  in  perspective. 

Johnson,  Bauer,  Moore,  and  Grant  suggest  a  methodology  for  sensitivity 
analysis  of  the  optimal  solution,  where  the  right-hand  side  vector  is  changed  (12). 
They  use  response  surface  methodology  that  incorporates  experimental  design  and 
least  squares  regression  to  develop  a  metamodel,  and  a  simple  kriging  technique  to 
improve  their  estimate  of  the  objective  fimction  value.  This  methodology  is  used  to 
predict  optimal  objective  function  value  based  on  values  of  elements  of  the  right-hand 
side,  thus  providing  a  description  of  the  relationship  between  the  right-hand  side  and 
the  objective  function  value.  This  relationship  can  then  provide  insights  into  the 
behavior  of  the  mathematical  programming  model. 

O’Keefe,  Balci,  and  Smith  describe  event  validity,  or  sensitivity  analysis,  as  a 
widely  used  mathematical  model  validation  technique  (18:88).  Sensitivity  analysis  is 
performed  by  systematically  changing  the  input  parameters  over  some  range  of 
interest  and  observing  the  effect  on  system  performance  (18:88).  Winston  defines 
sensitivity  analysis  as  “observing  how  changes  in  a  linear  program’s  parameters 
affect  the  optimal  solution”  (23:196).  He  goes  on  to  list  several  variations  in  the 
problem  that  should  be  considered.  (1).  Change  in  the  cost  vector;  (2).  Change  in  the 
right-hand  side  vector;  (3),  Change  in  the  constraint  matrix. 
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EXPERIMENTAL  DESIGN 


There  are  many  ways  to  approach  experimental  design.  Myers  and 
Montgomery  note  that  an  experiment  should  be  efficiently  designed  to  determine 
which  factors  are  likely  to  be  important  in  a  study  (16;  10).  Such  a  ‘screening 
experiment’  is  designed  to  investigate  factors  with  a  view  toward  eliminating  the 
unimportant  ones. 

Factorial  designs  are  widely  used  in  experiments  involving  several  factors 
where  it  is  necessary  to  investigate  the  joint  effects  of  the  factors  on  a  response 
(16:79).  A  special  case  of  factorial  designs  is  the  2^  design  where  each  of  k  factors  of 
interest  has  only  two  levels.  With  k  factors,  each  replicate  of  this  design  has  exactly 
2^  trials  or  runs.  A  2^  design  is  especially  useful  when  screening  experiments  should 
be  performed  to  identify  the  important  processes  or  factors  (16:79).  A  2^  factorial 
design  would  include  k  main  effects,  k  choose  2  two-factor  interactions,  k  choose  3 
three-factor  interactions, . . . ,  up  to  one  factor  interaction.  In  all,  2^  designs  can 
determine,  through  the  use  of  multiple-linear  regression,  up  to  2*-l  effects  (16: 103). 
“These  multi-factor  investigations  permit  the  analysis  of  a  number  of  factors  with  the 
same  precision  as  if  the  entire  experiment  had  been  devoted  to  the  study  of  only  one 
factor”  (17:1046). 

The  EXCEL  ’97  SOLVER 

Fylstra,  Lasdon,  Watson,  and  Waren  note  that  optimization  in  Microsoft  Excel 
begins  with  an  ordinary  spreadsheet  model.  “Solver  was  designed  to  make 
optimization  an  everyday  feature  of  spreadsheets”  (9: 54).  Solver  is  capable  of 
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incorporating  all  of  Excel’s  built  in  functions  and  can  handle  up  to  200  variables  with 
an  unlimited  number  of  constraints  (9:33). 

To  incorporate  Solver  into  a  spreadsheet,  the  user  identifies  cells  that  specify 
an  objective  function  to  be  optimized  and  constraints  that  the  objective  function  is 
subject  to.  Cells  are  also  set  aside  as  variables.  Solver  then  analyzes  the  complete 
optimization  model  and  produces  the  matrix  form  required  by  most  commercial 
optimizers  (9:36).  When  the  Assume  Linear  option  is  selected,  Solver  uses  a 
straightforward  implementation  of  the  simplex  method  with  bounded  variables  to  find 
the  optimal  solution  (9:36).  Solver  then  uses  the  solution  values  to  update  the  cells 
within  the  spreadsheet. 

Ragsdale  offers  four  basic  guidelines  to  be  followed  when  formulating  a  linear 
programming  problem  and  implementing  it  in  a  spreadsheet  (19:45): 

1 .  Organize  the  data  for  the  model  on  the  spreadsheet.  There  are  many  ways 
to  organize  data.  The  most  important  thing  to  accomplish  is  to  organize  data 
so  their  “meaning  and  purpose  are  as  clear  as  possible”  (19:45). 

2.  Reserve  separate  cells  in  the  spreadsheet  to  represent  each  decision 
variable  in  the  model.  Any  cells  can  be  used,  but  it  is  best  to  arrange  these 
cells  in  a  manner  that  parallels  the  structure  of  the  data. 

3.  Create  a  formula  in  a  cell  that  corresponds  to  the  objective  function  in  the 
model.  This  corresponds  to  the  objective  function  and  will  be  used  by  Solver 
to  achieve  optimization. 

4.  For  each  constraint  in  the  model,  create  a  formula  in  a  cell  in  the 
spreadsheet  that  corresponds  to  the  left-hand  side  of  the  constraint.  Each  of 
these  cells  must  be  matched  with  a  cell  containing  the  corresponding  right- 
hand  side  parameter. 


Figure  1  contains  a  sample  spreadsheet  model  (19:46).  The  mathematical 
model  associated  with  Figure  1  is  a  basic  maximization  problem.  The  company 
involved  is  simply  trying  to  maximize  profits  by  optimizing  the  number  of  each 
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product  built,  while  meeting  the  equipment  availability  constraints.  The 


maximization  is  formulated  as  follows: 

Maximize  350xi  + 

300x2 

Subject  to: 

Xi  + 

X2<= 

200 

9xi  + 

6X2  <= 

1566 

12xi  + 

16X2  <= 

2880 

Xi,  X2  <= 

0 

Aqua-Spas 

Hydro-Luxes 

- 

Number  to  make: 

78 

Total  Profit: 

Unit  Profits: 

$350 

$300 

$66,100 

Constraints: 

Used 

Available 

-  Pumps  Req'd 

1 

1 

200 

200 

-  Labor  Req'd 

9 

6 

1566 

1566 

-Tubing  Req'd 

12 

16 

2712 

2880 

Figure  1:  Example  of  a  Spreadsheet  Model  (19:46) 


There  is  a  history  for  the  use  of  the  Markov  decision  process  in  personnel 
modeling.  The  literature  reviewed  in  this  chapter,  although  not  all-encompassing 
provides  the  basis  for  the  remainder  of  this  thesis  effort.  Future  chapters  expand  upon 
this  review,  and  incorporate  many  of  the  formulas  and  principles  suggested. 
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CHAPTER  in 


METHODOLOGY 


INTRODUCTION 

The  EDFLOW  model,  or  QuAM  as  it  has  come  to  be  known,  was  originally 
developed  to  answer  some  specific  questions  and  not  as  a  planning  tool.  It  was  coded 
in  FORTRAN  77  to  run  in  batch  mode  and  not  interactive.  This  chapter  discusses  the 
methodology  developed  to  transport  QuAM  to  an  Excel  spreadsheet  environment. 

The  methodology  behind  the  experimental  design  used  to  test  the  model  for 
sensitivity  to  changes  in  its  input  parameters  and  cost  function  is  also  discussed. 

The  FORTRAN  77  version  of  QuAM  can  be  viewed  in  Appendix  A.  The 
code  shows  that  the  FORTRAN  program  calls  a  data  file  that  contains  the  input 
parameters.  The  main  program  then  manipulates  the  data  into  arrays  and  calls  a 
mathematical  programming  solver  to  do  the  optimization.  The  results  of  the  main 
program  are  then  written  into  an  output  file  that  must  be  called  for  viewing.  To 
develop  a  spreadsheet  version  of  QuAM,  each  of  the  functions  handled  by  the  three 
individual  FORTRAN  files  must  be  incorporated  into  one  Excel  workbook. 

QuAM:  The  SPREADSHEET  VERSION 

The  EDFLOW  model,  coded  in  FORTRAN  77,  is  not  used  in  any  way  when 
moving  to  an  Excel  spreadsheet  environment.  The  critical  factors  needed  for  creating 
a  user-friendly  spreadsheet  are  the  mathematical  formulation  of  the  model  presented 
in  Chapter  H,  along  with  the  knowledge  of  Excel  Solver  ’97  that  was  also  presented. 
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Recall  Ragsdale’s  four  basic  guidelines  to  spreadsheet  model  development  and 
applies  those  techniques  to  the  mathematical  formulation  and  Equations  (2-1)  through 
(2-28),  a  user-friendly  spreadsheet  model  should  be  achievable.  The  model  achieved 
can  then  be  compared  to  the  FORTRAN  77  implementation  as  verification  of  the 
mathematical  processes. 

Begin  by  reviewing  the  required  parameters  and  variables  of  the  mathematical 
formulation,  so  that  Ragsdale’s  guidelines  can  be  applied  and  the  beginnings  of  a 
spreadsheet  can  be  formulated: 

Parameters 

ai,d  -  attrition  probability  for  officers  with  i  years  of  service  and  degree  level  d 
Rd,g  =  requirement  for  officers  with  degree  level  d  and  grade  g 
Yd  -  inventory  factor  for  degree  level  d  (desired  ratio  of  inventory  to 
authorized  positions) 

Variables 

Xi,u=  number  of  officers  with ;  years  of  service  and  k  years  graduate  education 
(no  action  taken) 

x\,k=  number  of  officers  with  i  years  of  service  and  k  years  graduate 
education  (sent  to  school) 

Indices 

1  =  0,..., 23 

d  =  0, 1,2(BS,  MS,  PhD) 
g  =  2, 3, 4,  5, 6  (Lt,  Capt,  Maj,  Lt  Col,  Col) 

A:  =  0, 1, 2, 3, 4,  5  (BS,  MS  student,  MS,  PhD  student,  PhD  student,  PhD) 
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The  parameters  of  attrition,  requirements,  and  inventory  factor  fall  under 
Ragsdale’s  first  guideline  (organize  data).  The  attrition  data  requires  a  3  x  23  block 
of  cells  on  the  spreadsheet,  and  is  based  on  degree  level  (See  Tablel).  These  cells  are 
laid  out  with  years  of  service  at  the  top  of  each  column  and  degree  level  at  the  start  of 
each  row. 


Table  1:  Attrition  Data  Setup 


Year 

d 

0 

1 

2 

3 

4 

5 

•  •  • 

22 

«1.0 

«2.0 

<*3.0 

<*4,0 

<*5,0 

•  •  • 

1 

0 

«2,1 

<*3,1 

<*4.1 

«5,1 

•  •  • 

2 

0 

0 

0 

0 

0 

<*5,2 

•  «  • 

The  requirements  data  requires  a  3  x  5  block  of  cells  on  the  spreadsheet  (See 
Table  2).  These  cells  are  laid  out  with  military  grade  along  the  top  of  each  column 
and  with  degree  level  at  the  start  of  each  row. 


Table  2:  Requirements  Data  Setup 


Grade 

d 

Lt 

Capt 

HESSm 

Col 

Risf 

-^3,0 

^4.0 

^5.0 

^6.0 

1 

R2.1 

Rid 

Raa 

Rs,i 

Re,! 

2 

Ria 

Ria 

R42 

Rsd 

_ Rs^ _ 

The  inventory  factor  requires  a  3  x  1  block  of  cells  on  the  spreadsheet  (Table  3). 


Table  3;  Inventory  Factor  Setup 


BS 

Yo 

MS 

Yi 

PhD 

_ I2 _ 
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The  variables  x  and  x’  fall  under  Ragsdale’s  second  guideline.  For  ease  of 
use,  and  to  mirror  the  structure  of  the  attrition  data,  the  variable  cells  are  arranged  in 
an  8  X  24  block  on  the  spreadsheet  (Table  4).  These  cells  are  also  laid  out  with  years 
of  service  across  the  top  of  each  column.  Years  of  advanced  education  begin  each 
row. 


Table  4:  Variable  Setup 


Year 

mm 

0 

1 

2 

3 

4 

5 

•  •  • 

20 

21 

22 

23 

lEB 

mm 

1^^ 

a:4,o 

•  •  • 

jc’l,0 

a:  4,0 

x’5.0 

•  •  • 

Esn 

0 

HH 

1 

a:4.i 

*  •  • 

HB 

2 

0 

HB 

X3a 

X4Ji 

•  •  • 

Xioa 

X2ia 

X22a 

•*23,2 

2 

0 

HH 

x*3a 

x’4a 

•  •  • 

x’loa 

0 

0 

0 

3 

0 

0 

0 

X3;3 

X4:3 

xs:3 

•  •  • 

X20,3 

X21,3 

0 

BB 

4 

0 

0 

0 

iHB 

ijj^n 

•  •  • 

BBI 

5 

0 

0 

0 

BH 

HH 

1^9 

•  •  • 

With  the  basic  setup  presented  in  Tables  1-4,  the  beginnings  of  a  usable 
spreadsheet  formulation  of  the  problem  are  available.  The  next  thing  that  needs  to  be 
done  can  be  determined  from  Ragsdale’s  third  guideline:  create  a  formula  in  a  cell  in 
the  spreadsheet  that  corresponds  to  the  objective  function  in  the  model  (19:45).  The 
objective  function  for  this  model  is  given  in  Equation  (2-1).  For  this  application, 
however.  Equation  (2-1)  is  modified  to  give  the  optimal  number  of  man-years 
annually.  This  is  easily  done  by  multiplying  the  sum  of  x’i,o  by  1.5  (the  man-year 
cost  of  an  MS  Degree)  and  the  sum  of  x\2  by  3 .0  (the  man-year  cost  of  a  PhD  degree) 
rather  than  the  respective  relative  costs  of  1 .0  and  2.0  that  were  used  in  Dietz’s 
original  formulation.  Because  this  formulation  does  not  change  the  original  1:2  ratio. 
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this  change  does  not  affect  the  optimal  annual  number  of  MS  and  PhD  quotas 

determined.  This  change  is  given  by: 

21  20 


Minimize  l.SXxVo  +  ^.O^jc',.^  (3-1) 

1=0  1=2 

In  order  to  track  MS  quotas  and  PhD  quotas  separately  from  man-years,  it  is 
necessary  to  create  separate  cells  in  the  spreadsheet  to  accomplish  that  task.  Once 
those  cells  are  created,  it  is  a  simple  task  to  create  a  cell  for  the  objective  function. 
Table  5  displays  one  way  this  can  be  accomplished. 


Table  5:  Objective  Function 


MS  Quota 

21 

ZjcVo 

1=0 

PhD  Quota 

20 

£^2 

t=2 

Man-years 

21  20 

1-5£2!:',,o  +  3.o£x'/,2 

/=0  1=2 

To  finish  the  spreadsheet  formulation  of  this  function,  it  is  necessary  to  look  at 
Ragsdale’s  fourth  guideline;  namely,  for  each  constraint  in  the  model,  create  a 
formula  in  a  cell  for  both  the  left-hand  side  and  the  right-hand  side  of  the  constraint. 
The  constraints  for  this  model  are  contained  in  Equations  (2-2)  through  (2-28). 

Equations  (2-2)  through  (2-13)  specify  the  global  balance  constraints.  Global 
balance  constraints  ensure  that  the  rate  of  transition  out  of  any  state  equals  the  rate  of 
transition  into  that  state  from  all  other  states  (3:75).  There  are  a  total  of  125  equality 
constraints  for  the  global  balance  portion  of  the  formulation.  Equations  (2-2)  through 
(2-5)  generate  the  constraints  for  variables  Xi,o  and  These  equations  are  listed  for 
reference: 
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(2-2) 


22  22  22 

^0,0  -^Vo  ~  S  ^3fi,0  ^1,0  X23,0  Xi,2  ^23,2  ^  Cii,2  Xi,5  ^23,5 

’  i=l  i=2  i=3 


^1,0  .X  1,0  ”  -Xo.o 

(2-3) 

Xj\o  X  j,o  0  X j-i^o 

7-2,..., 21 

(2-4) 

Xj,0  “  0  ~  0)  X j-l,Q 

7  =  22,23 

(2-5) 

In  order  to  formulate  each  of  these  equations,  left-hand  side  (LHS) 

and  right- 

hand  side  (RHS),  in  its  own  cell,  it  is  necessary  to  reserve  a  2  x  24  block  of  cells  in 
the  spreadsheet.  Table  6  contains  one  possible  formulation  for  this  block  of  cells. 


Table  6:  Constraints  {Xj,o  and  x’j,o) 


Year  (/) 

Parameter 

0 

1 

2,...,  21 

22,23 

LHS 

ACo.o+^’o.o 

JCi.0+^’1.0 

JCi.0+Jf’/.0 

xj,o _ 

RHS 

RHS  (2-2)  n 

Xo.o 

(l-a;-l.o)^/-1.0 

(l-aj.i.o)x,-i.o 

Equation  (2-6)  specifies  the  constraints  for  the  ^9,1  variables.  Equation  (2-6)  is 
shown  and  can  be  incorporated  into  the  spreadsheet  by  reserving  a  2  x  22  block  of 
cells.  Table  7  contains  one  possible  formulation  for  this  block  of  cells. 


Xj\\  X  y-1,0 


j=\,...,22  (2-6) 


Table  7:  Constraints  (^9,1) 


Year  (/) 

Parameter 

1,...,  22 

LHS 

_ m _ 

RHS 

_ Jg’/-i.o _ 

Equations  (2-7),  (2-8),  and  (2-9)  contain  the  constraints  for  the  09,2  and  x*j;i 
variables.  These  equations  can  be  incorporated  into  the  spreadsheet  by  reserving  a 


22 


2  X  22  block  of  cells  for  formula  entry.  One  possible  formulation  for  these  22 
constraints  can  be  seen  in  Table  8. 


Xza  x’2,2  “  ^1,1 

(2-7) 

Xj\2  +  x'ja  =  (1  ”  aj-u)xj-i2  +  Xj-u 

7  =  3,..., 20 

(2-8) 

Xj^2  “  0  “  X ;-l,2  X y_l,l 

7  =  21,..., 23 

(2-9) 

Table  8:  Constraints  (xj^t  and 


Year  (/) . 

Parameter 

2 

3,...,  20 

21,...,  23 

LHS 

Xi.l+X'i.2 

X22+X"2a 

XJ.2 _ 

RHS 

(l-aj-ij)xj.i+XjA,i  \ 

Xl,l 

(l-ai.i2)Xi.i+Xi.ui 

Equation  (2-10)  generates  the  19  constraints  containing  theAf^^a  variables. 

These  19  constraints  can  be  formulated  on  the  spreadsheet  by  reserving  a  2  x  19  block 
of  cells  for  formula  entry.  Equation  (2-10)  is  listed  for  reference,  along  with  one 
possible  formulation  for  this  set  of  constraints,  which  is  shown  in  Table  9. 


= 


;-i,2 


7  =  3,...,  21  (2-10) 


Table  9:  Constraints  (xj^) 


Year  (/) 

Parameter 

3,...,  21 

LHS 

_ m _ _ 

RHS 

X^i.l2 

The  19  constraints  on  the  09,4  variables  are  created  by  Equation  (2-11). 
Following  the  same  format  that  has  been  used  throughout  this  spreadsheet 
formulation,  these  constraints  require  a  block  of  2  x  19  cells  for  formula  entry. 
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Equation  (2-1 1)  is  shown  for  reference,  along  with  Table  10,  which  contains  one 
possible  formulation  for  this  group  of  constraints. 

=  j  =  A,...,22  (2-11) 


Table  10:  Constraints  (Xj,4) 


Year  (/) 

Parameter 

4,...,  22 

LHS 

Xi.4 

RHS 

Xlia 

The  final  19  of  the  125  global  balance  constraints  are  specified  by  Equations 
(2-12)  and  (2-13).  These  constraints  require  that  a  2  x  19  block  of  cells  be  reserved 
on  the  spreadsheet  for  formula  entry.  The  equations  are  listed  for  reference.  Table  1 1 
contains  one  possible  way  to  formulate  this  block  of  constraints. 

X5,5  =  X4A  (2-12) 

XjA  =  (1  -  aj-u)Xj-i5  +  Xj-'IA  j  =  6,...,23  (2-13) 


Table  11:  Constraints  (xj^) 


Year  (i) 

Parameter 

5 

23 

LHS 

■>£^.5 

RHS 

X4,4 

_ (l-fl/-l.s)y/-1.5+Ji:/-1.4 

That  concludes  the  formulation  of  the  global  balance  constraints.  Cells  for  the 
inventory  demand  constraints  must  now  be  reserved.  Inventory  demand  constraints 
ensure  that  all  personnel  inventory  demands  are  met  (3:75).  There  are  a  total  of  14 
inventory  demand  constraints.  These  constraints  are  specified  by  Equations  (2-14) 
through  (2-27).  Notice  that  these  constraints  are  greater  than  or  equal  to  constraints 
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rather  than  the  equalities  described  by  the  global  balance  constraints.  This  is  due  to 
the  fact  that  the  RHS  describes  a  minimum  requirement  that  must  be  met  in  order  to 
meet  inventory  requirements.  This  block  of  constraints  requires  that  a  14  x  2  block  of 
cells  be  reserved  for  constraint  formula  entry  (Table  12). 

tx,.,  +  txu^tR..,r,  (2-14) 

/=0  i=2 

10  10  10  2 

Z Xi,o  +  Z JC/,2  +  Z  X/,5  ^  Z  Rd,i Yd  ^ 

/=4  /=5  <i=0 

15  15  15  2 

'Lxuo  +  Zx/.2  +  ZXi.5  ^  URdAYd 

i=ll  1=11  1=11  t^=0 

19  19  19  2 

Zx-.o  +  'Lxia  +  Zx,'.j  ^  l.Rd,iYd 

i=\6  i=16  7=16  d=0 

23  23  23  2 

11x1,0+  Z.X,-2+  llXi,5^  llRd,6Yd 

7=20  7=20  7=20  d=0 

3  2 

llXi,2^1lRd,2Y  d 

7=2  c?=l 

10  10  2 

Zx,,2  +  Zx.5  ^  llRd^Yd 

7=4  7=5  i/=l 


15  15  2 


llxi,2  +  llxi,s^llRdAYd 

7=11  7=11  d^\ 

(2-21) 

19  19  2 

HXia+UXiA^'LRdAYd 

7=16  7=16  rf=l 

(2-22) 

23  23  2 

ZXi.2+  llXi,5^1lRd,6Yd 

7=20  7=20  if=l 

(2-23) 

10 

S  Xi^5  -  (Ria  Ri.z)  Y 2 

7=5 

(2-24) 

15 

SXj,5  ~  RiaY 2 

7=11 

(2-25) 

(2-16) 

(2-17) 

(2-18) 

(2-19) 

(2-20) 
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(2-26) 


19 

i=16 

Zx,3^i?2.672 

>■=20 


Table  12:  Inventory  Demand  Constraints 


LHS 

RHS 

3  3 

2 

lLXi,0  +  llXi,2 

/=0  i^2 

10  10  10 

2 

llXi,o  +  llXi,2  +  llXi,5 

1=4  1=4  i=5 

(/=0 

15  15  15 

2 

'LXi,0+'LXi,2+'LXu5 

l^RdAYd 

1=11  i=ll  1=11 

d=0 

19  19  19 

2 

Xx,,0+  Xx,,2+  Lx, ,5 

I^R^aY, 

1=16  /=16  t=16 

t/=0 

23  23  23 

2 

Lx,-,o+  Lxi,2+  Lx,,5 

'LRdAYd 

i=20  j=20  1=20 

d=Q 

3 

2 

Lx,  2 

llRd.zYa 

z=2 

d=l 

10  10 

2 

LX(.2  +  LXi.5 

'LRdAY, 

1=4  1=5 

d=\ 

15  15 

2 

Lx,',2+Lx>.j 

l^RdAYd 

z=U  t=ll 

d^\ 

19  19 

2 

LXi,2+Lx,.5 

URdAYj 

J=1 

1=16  1=16 

23  23 

2 

Lx,-,2+  Lx,,5 

H-RdAYd 

1=20  1=20 

d^\ 

10 

Lx, .5 

1=5 

(i?2,2  ■*"  i?2,3)?^2 

15 

Lx,,j 

1=11 

RiaY  2 

19 

Lxi,5 

il6 

R2AY2 

23 

Lx,,5 

1=20 

Rx^Y  2 

The  final  constraint  that  must  be  included  in  this  formulation  is  Equation 
(2-28),  which  is  the  non-negativity  constraint.  Ensuring  that  all  of  the  variables  are 
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non-negative  can  be  handled  within  Solver  itself  and  does  not  need  to  be  entered  into 
individual  cells  of  the  spreadsheet.  This  is  accomplished  by  checking  the  Assume 
Non-Negative  option  block  in  the  Solver  Option  Dialogue  box  (9:36). 

Once  the  parameters  (attrition,  requirements,  inventory  factor),  variables  (x/,* 
and  x’ife),  constraints  (global  balance  and  inventory  demand),  and  objective  function 
have  been  entered  into  the  spreadsheet,  Solver  can  be  formatted  to  formulate  the 
optimization.  Solver  is  called  by  selecting  the  Tools  menu  and  selecting  Solver. 
When  called,  the  Solver  Parameters  dialog  box  is  displayed.  There  are  four  entries 
requiring  values  (9:35): 

1.  Set  Target  Cell:  This  is  linked  to  the  cell  that  contains  the  objective 
function. 

2.  Equal  To.  ‘Min’  should  be  checked  for  this  formulation. 

3.  By  Changing  Cells:  This  is  linked  to  the  cells  that  have  been  reserved  for 
the  variables. 

4.  Subject  to  the  Constraints:  Each  of  the  blocks  of  constraints  should  be 
added  to  the  Constraint  List  box,  by  using  the  Add,  Change,  or  Delete  buttons. 

Once  the  Solver  Parameters  have  been  updated,  the  Options  button  should  be 

clicked  to  get  to  the  Solver  Options  Dialogue  box.  On  this  screen  it  is  necessary  to 

check  the  Assume  Linear  Model  box,  the  Assume  Non-Negative  box,  and  the  Use 

Automatic  Scaling  box.  The  Assume  Linear  Model  box  determines  that  the  simplex 

method  is  used  for  the  optimization  (9:36).  The  Assume  Non-Negative  box  places 

lower  bounds  of  zero  on  all  variables  (9:36).  When  Use  Automatic  Scaling  is 

selected.  Solver  rescales  columns,  rows,  and  RHSs  to  a  common  magnitude  before 

beginning  the  simplex  method.  Solver  then  unscales  the  solution  values  prior  to 

entering  them  in  the  spreadsheet  (9:39).  One  final  box  that  should  be  looked  at  on 

this  screen  is  the  Max  Time  box,  which  controls  how  long  Solver  searches  for  an 
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answer  prior  to  providing  an  error  message.  After  updating  all  required  cells,  return 
to  the  Solver  Parameters  dialog  box  and  select  Solve  to  engage  Solver  and  search  for 
an  optimal  solution. 

With  the  basic  spreadsheet  formulated  and  with  Solver  formatted,  it  is  now 
possible  to  use  a  simple  Visual  Basic  for  Applications  (VBA)  subroutine  to  link  the 
requirement  data  for  each  of  the  26  individual  Academic  Specialty  Codes  (ASCs)  into 
the  basic  spreadsheet.  With  this  accomplished.  Solver  can  then  be  called 
automatically,  after  each  change  of  requirements.  Solver  then  determines  an  optimal 
solution  for  each  ASC.  These  solutions  are  then  mapped  into  individual  cells  in  the 
Excel  Workbook  for  data  collection. 

SENSITIVITY  ANALYSIS 

Winston  and  O’Keefe  both  describe  sensitivity  analysis  as  systematically 
changing  the  input  parameters  of  the  optimization  and  observing  what  happens  to  the 
optimal  solution.  They  also  stress  that  changes  should  be  made  to  both  the  RHS,  and 
LHS,  and  finally,  the  cost  vector  should  be  varied  to  determine  the  effect  of  changes 
on  the  optimal  solution.  This  systematic  changing  of  the  parameters  is  the  topic  of 
this  section  of  research.  The  objective  is  to  present  a  methodology  that  smartly  and 
systematically  varies  the  input  parameters  of  the  QuAM  model,  so  that  least  squares 
multiple-regression  can  be  performed  on  the  data  to  determine  significant  factors. 

The  input  parameters  of  the  QuAM  model  are  attrition  («»,</),  requirements 
{Rg,d),  and  inventory  factor  Attrition  is  a  single  data  set  that  was  derived  from 

AFPC  historical  data  (3:76).  The  requirements  are  26  different  data  sets,  one  for  each 
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ASC.  The  requirements  for  each  ASC  are  determined  and  maintained  by  the 
individual  ASMs  (15).  There  are  three  inventory  factors  that  are  used  in  this 
formulation  (70,  Y\,  Y^-  These  inventory  factors  are  built  into  the  model  so  that 
requirements  “can  be  scaled  up  to  reflect  external  factors  such  as  assignment 
overlaps,  career  broadening  assignments,  resident  professional  military  education, 
operational  assignments,  etc.”  (3:76).  Basically,  these  factors  allow  for  additional  on- 
hand  inventory  to  fill  requirements. 

It  is  easy  to  see  that  the  inventory  factors  can  be  varied  directly  in  the 
formulation,  just  by  updating  the  value  stored  in  the  appropriate  cell  (Refer  to  Table 
3).  The  problem  is  how  to  systematically  change  the  attrition  and  requirements.  To 
make  a  constant  change  to  one  of  these  data  sets,  it  is  necessary  to  add  a 
multiplication  factor  in  the  formulation  of  the  spreadsheet.  This  factor  when  set  to 
1.0  returns  data  values  at  100  percent.  When  set  to  other  than  1.0,  each  member  of 
the  data  set  is  multiplied  by  the  factor.  A  factor  of  0.9  produces  an  across  the  board 
decrease  of  10  percent,  while  a  factor  of  1 . 1  produces  a  10  percent  increase  in  the  data 
values.  The  introduction  of  this  factor  {a  for  attrition,  and  p  for  requirement)  into  the 
spreadsheet  formulation  can  be  seen  in  Tables  13  and  14.  The  factor  itself  can  easily 
be  imbedded  in  any  cell  within  the  spreadsheet. 


Table  13;  Attrition  Factor  (a) 


Year 

d 

0 

1 

2 

3 

4 

5 

•  •  • 

22 

0 

aao.o 

Ctfll.O 

aa2.o 

aa3.o 

Ctfl4.0 

aas.o 

•  •  • 

aa22.o 

1 

0 

0 

aia^^ 

aa3.i 

aa4j 

aa&i 

•  •  • 

(X<*22,1 

2 

0  . 

0 

0 

0 

0 

aosa 

•  •  • 

Clfl22a 
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Table  14:  Requirement  Factor  {p) 


Grade 

d 

Lt 

Capt 

LtCol 

Col 

pRisi 

pRxo 

pRajo 

pRsja 

pResi 

1 

PRIA 

. pRiA 

pR*,! 

pRsA 

pRes 

2 

pRia 

_ _ 

_ PR42 

_ pRs2 

_ PEsI _ 

The  model  now  has  five  factors  (a,  p,  /o,  yu  T2),  which  can  be  systematically 
changed.  When  a  is  changed,  changes  are  initiated  only  in  the  LHS  of  the  global 
balance  constraints,  which  include  attrition  information.  This  change  to  the  LHS  can 
be  seen  by  reformatting  any  of  the  global  balance  constraints  that  include  attrition. 
For  example,  if  all  of  the  variables  in  Equation  (2-4)  are  moved  to  the  LHS,  it  is 
obvious  that  any  change  in  attrition  caused  by  a  only  affects  the  LHS.  See  Equation 
(3-2). 

Xj,o  +  x'j,o  -  (1  -  Gj-ifi)  Xy-1,0  =  0  y  =  2, . . . ,  2 1  (3-2) 

When  p,  or  any  yj  is  changed,  changes  are  observed  only  in  the  RHS  of  the 
inventory  demand  constraints.  This  can  be  verified  by  looking  at  any  of  the  14 
inventory  demand  constraints.  In  Equation  (2-15),  notice  that  changes  to  either  the 

inventory  factor  or  requirement  factor  only  affect  the  RHS  of  the  equation. 

10  10  10  2 

'Lxi,o+l,Xi,2+Txi,5^'LRd,3r^  (2-15) 

i=4  1=4  i=5  d=0 

With  this  in  mind,  QuAM  now  has  five  factors  that  are  capable  of  changing 
both  the  LHS  and  the  RHS  of  the  optimization  formulation  within  Solver.  These 
changes  are  accomplished  by  changing  cells  within  the  spreadsheet,  not  by  changing 
the  format  of  the  optimization  programmed  within  Solver.  Cells  within  the 
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spreadsheet  are  easily  manipulated  through  the  use  of  simple  VBA  subroutines.  This 
makes  applying  an  experimental  design  easy. 

The  cost  function  can  also  be  changed  in  this  formulation.  Simply 
manipulating  the  formula  for  the  objective  function  that  Solver  is  using  for  the 
minimization  can  do  this  changing  of  the  cost  function.  Using  Equation  (3-1),  there  is 
one  cost  for  MS  degrees  and  one  cost  for  PhD  degrees.  The  goal  of  this  portion  of  the 
sensitivity  analysis  is  to  see  how  small  changes  in  the  cost  fixnction  effect  the  model 
outputs.  It  is  therefore  possible  to  systematically  change  Equation  (3-1)  and  possibly 
observe  changes  in  the  optimal  solution  by  using  a  two-factor  (2^)  experiment. 


EXPERIMENTAL  DESIGN 

The  goal  of  experimental  design  is  to  efficiently  design  experiments  that  will 
provide  some  type  of  useful  information  (16: 12).  In  this  research,  the  experimental 
goal  is  to  look  for  model  sensitivity  to  its  input  parameters.  In  other  words,  the 
purpose  of  this  portion  of  the  research  is  to  design  an  experiment  that  varies  the  five 
input  parameters  and  records  the  model’s  outputs  of  MS  quota,  PhD  quota,  and  man- 
years.  The  parameter  settings  are  then  incorporated  into  a  multiple-linear  regression 
against  the  model’s  output  at  each  of  the  different  factor  settings.  The  results  of  the 
regression  are  then  used  to  determine  which  factors  are  significant  to  each  of  the 
outputs. 

Recall  from  Chapter  II  that  a  2^  factorial  experiment  is  a  common  method 
used  to  determine  significant  factors.  In  a  2*  factorial  experiment,  each  of  the  k 
factors  is  assigned  two  levels,  low  and  high,  or  in  the  case  of  a  coded  variable,  -1  and 
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+1 .  The  purpose  of  using  coded  variables  in  this  type  of  situation  is  to  remove  the 
natural  units  from  the  formulation.  “Coded  variables  are  usually  defined  to  be 
dimensionless  with  mean  zero  and  the  same  spread  or  standard  deviation”  (16:3). 

With  a  total  of  five  input  factors,  ork=5,  this  experiment  requires  2^  total 
runs.  With  a  full  run  of  32  experiments,  it  is  possible  to  use  multiple-linear 
regression  not  only  to  determine  significant  main  effects,  which  is  the  main  goal  of 
this  research,  but  also  any  interaction  effects  that  might  be  present.  One  possible  2^ 
factorial  coded  experiment  using  QuAM’s  input  factors  can  be  seen  in  Table  15. 

Each  of  the  five  input  variables  in  this  formulation  needs  to  be  coded  into  low 
and  high  levels  for  this  sensitivity  experiment.  The  two  levels  chosen  for  each  of  the 
input  variables  needs  to  span  their  respective  expected  operating  region.  This 
spanning  ensures  that  any  conclusions  drawn  from  the  regression  are  valid  under 
normal  operating  conditions  (17: 1047). 

It  is  safe  to  assume  that  the  center  or  zero  point  of  both  a  and  p  is  at  1.0. 

Recall  that  a  factor  of  1 .0  uses  the  current  attrition  and  requirement  data  with  no 
changes.  Additionally,  assuming  that  both  the  attrition  and  requirement  data  is 
reasonably  stable,  a  change  of  +/-10  percent  adequately  encloses  the  normal  operating 
region  for  these  factors. 

The  three  inventory  factors  should  never  be  set  below  a  value  of  1 .0.  With 
inventory  factors  set  to  1.0,  QuAM  returns  the  steady-state  number  of  quotas 
necessary  to  maintain  the  ASC  requirement  with  no  excess  inventory,  or  overlap  of 
personnel  available.  This  means  at  steady-state,  the  inventory  will  only  support  the 
requirements  and  ASC  attrition.  Any  other  demands,  such  as  resident  PME,  could  not 
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To  run  this  experiment  in  the  QuAM  model,  it  is  necessary  for  the  inputs  to 
the  model  to  be  natural  variables  or  non-coded.  Table  17  shows  the  corresponding 
natural  values  that  coincide  with  the  coded  variables  in  Table  15.  To  run  this 
experiment,  it  is  necessary  to  update  the  appropriate  cells  within  the  spreadsheet  prior 
to  each  run  of  Solver.  This  cell  manipulation  is  easily  accomplished  using  a  VBA 
subroutine.  After  Solver  determines  an  optimal  solution,  appropriate  data  is  recorded 
prior  to  the  next  set  of  input  parameters  being  loaded.  This  process  continues  until 
each  of  the  32  runs  is  completed. 


Table  16:  Coded  Input  Variables 


Factor 

-1 

0 

+  1 

a 

0.9 

1.0 

1.1 

_ e. _ 

0.9 

1.0 

1.1 

To 

1.0 

1.25 

1.5 

_ ri _ 

1.0 

L25 

1.5 

_ 22 _ 

1.0 

1.25 

Ts 

Having  completed  the  required  runs,  any  of  the  common  statistical  packages, 
including  Excel’s  Data  Analysis  Tool  Pak  (DATP)  can  be  used  to  run  the  multiple- 
linear  regression.  The  coded  variables  are  used  as  the  X  parameters  and  MS  quota, 
PhD  quota,  and  man-years  are  used  individually  as  the  Y  parameter.  The  goal  is  to 
determine  factors  significant  to  each  of  the  model’s  outputs.  Therefore,  using  a  95 
percent  confidence  level,  any  factor  with  a  P-value  less  than  or  equal  to  0.05  would 
be  considered  significant  (17. 1243).  Figure  2  is  an  example  of  an  ANOVA  table  that 
summarizes  the  regression  results  received  from  DATP.  Note  that  factor  yo  is  not 
significant  to  the  regression  and  could  be  removed. 
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Table  17:  Natural  Input  Factors 


Run  # 

a 

_ p 

yo 

Y\ 

72 

1 

0.9 

0.9 

1.0 

1.0 

-J - LJZ _ 

1.0 

2 

0.9 

0.9 

1.0 

1.0 

1.5 

3 

0.9 

0.9 

1.0 

1.5 

1.0 

4 

0.9 

0.9 

1.0 

1.5 

1.5 

5 

0.9 

0.9 

1.5 

1.0 

1.0 

6 

0.9 

0.9 

1.5 

1.0 

1.5 

7 

0.9 

0.9 

1.5 

1.5 

1.0 

8 

0.9 

0.9 

1.5 

1.5 

1.5 

9 

0.9 

1.1 

1.0 

1.0 

1.0 

10 

0.9 

1.1 

1.0 

1.0 

1.5 

11 

0.9 

1.1 

1.0 

1.5 

1.0 

12 

0.9 

1.1 

1.0 

1.5 

1.5 

13 

0.9 

1.1 

1.5 

1.0 

1.0 

14 

0.9 

1.1 

1.5 

1.0 

1.5 

15 

0.9 

1.1 

1.5 

1.5 

1.0 

16 

0.9 

1.1 

1.5 

1.5 

1.5 

17 

i.i 

0.9 

1.0 

1.0 

1.0 

18 

1.1 

1  0.9 

r  1.0 

^  1.0 

1.5 

19 

1.1 

0.9 

1.0 

1.5 

r  1.0 

20 

1.1 

0.9 

1.0 

1.5 

1.5 

21 

1.1 

0.9 

1.5 

1.0 

1.0 

22 

1.1 

0.9 

1.5 

1.0 

1.5 

23 

1.1 

0.9 

1.5 

1.5 

1.0 

24 

1.1 

0.9 

1.5 

1.5 

1.5 

25 

1.1 

1.1 

1.0 

1.0 

1.0 

26 

1.1 

1.1 

1.0 

1.0 

1.5 

27 

1.1 

1.1 

1.0 

1.5 

1.0 

28 

1.1 

1.1 

1.0 

1.5 

1.5 

29 

1.1 

1.1 

1.5 

1.0 

1.0 

30 

1.1 

1.1 

1.5 

1.0 

1.5 

31 

1.1 

1.1 

1.5 

1.5 

1.0 

32 

1.1 

1.1 

1.5 

1.5 

1.5 

Now  that  an  experiment  is  designed  that  varies  both  the  LHS  and  the  RHS,  an 
experiment  needs  to  be  designed  to  look  at  what  happens  when  the  cost  function  is 
changed.  As  discussed  previously,  the  objective  hmction  in  QuAM  has  two  cost 
coefficients.  Therefore,  using  the  same  2*  methodology  already  described,  k  =  2,  only 
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four  runs  are  required  to  accomplish  this  experiment.  Possible  designs  for  this 


experiment  are  seen  below  in  Tables  18, 19,  and  20.  The  same  regression  analysis 
methodology  that  was  discussed  previously  is  used  to  evaluate  this  cost  experiment. 


1  ANOVA  “ — 1 

df 

SS 

MS 

F 

Significance  F 

Regression 

5 

480.048 

96.010 

601.726 

0.000 

Residual 

26 

4.148 

0.160 

Totai 

31 

484.196 

Coefficients 

Standard  Error 

tStat 

P-value 

intercept 

19.7933 

0.0706 

280.3084 

0.0000 

a 

0.7064 

0.0706 

10.0041 

0.0000 

R 

1.9793 

0.0706 

28.0308 

0.0000 

ro 

0.0000 

0.0706 

0.0000 

1.0000 

n 

3.1518 

0.0706 

44.6345 

0.0000 

72 

0.8069 

0.0706 

11.4272 

0.0000 

Figure  2:  DATP  ANOVA  Table 


Table  18:  Coded  2^  Experimental  Design 


Run  # 

MS  Cost 

PhD  Cost 

1 

1 

1 

2 

1 

-1 

3 

-1 

1 

4 

-1 

-1 

Table  19:  Coded  Cost  Variables 


Degree 

-1 

1 

MS 

0.5 

2.5 

PhD 

2.0 

4.0 

Table  20:  Natural  Cost  Variables 


Run  # 

MS  Cost 

PhD  Cost 

1 

2.5 

4.0 

2 

2.5 

2.0 

3 

0.5 

4.0 

4 

0.5 

2.0 
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QuAM  is  now  transported  from  FORTRAN  77  to  an  Excel  spreadsheet 
environment.  The  final  phase  of  this  research  is  to  verify  mathematical  formulation 
of  the  spreadsheet  model,  using  comparison  with  the  original  EDFLOW  model,  and 
to  perform  sensitivity  analysis  experiments  that  determine  significant  input 
parameters.  The  results  of  this  research  are  presented  in'Chapter  IV. 
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CHAPTER  IV 


RESULTS 


INTRODUCTON 

The  results  generated  by  running  the  QuAM  model  with  data  from  each  of  the 
26  ASCs  are  presented  and  compared  with  EDFLOW  at  two  different  inventory 
factor  settings.  This  is  accomplished  to  verify  the  mathematical  formulation  of  the 
model.  Sensitivity  analysis  is  performed  on  QuAM,  using  the  2*  factorial 
experimental  design  developed  in  Chapter  HI,  to  determine  the  model’s  sensitivity  to 
the  parameters  of  attrition,  requirements,  and  inventory  factor.  The  cost  function  is 
also  systematically  varied  to  determine  sensitivity  to  changes  in  the  cost  coefficients. 

Results  for  three  ASCs  (OYEY,  lAGE,  and  4Ixx)  are  presented  in  detail 
throughout  this  chapter.  See  Appendix  D  for  additional  results.  The  ASCs  OYEY, 
lAGE,  and  the  composite  ASC  4Ixx  are  chosen  because  they  are  representative  of  the 
entire  population  of  26  ASCs.  The  lAGE  ASC  represents  ASCs  with  a  small  PhD 
requirement  relative  to  the  MS  requirement  (less  than  10  percent),  OYEY  represents 
those  with  average  requirements  for  both  PhD  and  MS,  and  4Ixx  represents  those 
with  a  large  requirement  for  both  PhD  and  MS.  The  requirements  for  each  of  these 
ASCs  can  be  seen  in  Figure  3.  The  sensitivity  analysis  results  obtained  also  fall  along 
lines  that  mirror  the  three  groups  represented  by  the  three  ASCs  chosen. 
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Requirements  (1AGE): 


1AGE 

Lt 

■Bim 

LtCoi 

Col 

Total 

Ro.o 

iimijmii 

0 

0 

0 

0 

^IIIQIIIIIIII^ 

Rg,1 

17 

100 

23 

4 

2 

146 

Ro.2 

0 

5 

2 

1 

0 

8 

Requirements  (OYEY 

Total  I 

): 

154 

OYEY 

Lt 

LtCol 

Col 

Total 

Ra.O 

0 

0 

0 

0 

0 

Rfl.i 

6 

79 

40 

27 

3 

155 

Ra.2 

0 

9 

11 

12 

3 

35 

Total  1 

Requirements  (4lxx): 

190 

4lxx 

Lt 

Capt 

■Eiim 

LtCol 

Col 

Total 

Rg.o... . 

0 

0 

0 

0 

0 

Ro.i 

92 

291 

67 

18 

9 

477 

_ 

12 

50 

32 

17 

2 

113 

I  Total 

590 

Figure  3:  Requirements  for  lAGE,  OYEY,  and  4Ixx 


Typical  output  of  the  QuAM  model,  using  inventory  factor  values  of  1.0,  can 
be  seen  in  Figure  4.  This  output  provides  MS  quota,  PhD  quota,  man-years,  and  a 
breakdown  of  the  optimal  graduating  class.  The  optimal  graduating  class  is  presented 
by  military  grade,  and  provides  personnel  managers  with  a  class  structure  that  is  best 
suited  to  meeting  the  needs  of  the  Air  Force  in  a  steady-state  environment. 


1AGE 

ENVIR  &  ENGINEERING  MANAGEMENT 

Optimum:  per  year! 

Optimal  Graduating  Class  Structure 

MS: 

16.7 

9.3 

7.4 

0.0 

0.0 

0.0 

PhD: 

0.8 

0.0 

0.8 

0.0 

0.0 

0.0 

Man-years 

27.6 

Lt 

Capt 

Maj 

LtCol 

Col 

OYEY 

OPERATIONS  RESEARCH 

Optimum:  per  year! 

Optimal  Graduating  Class  Structure 

MS: 

15.8 

4.5 

10.1 

1.2 

0.0 

0.0 

PhD: 

3.5 

0.0 

1.5 

2.0 

0.0 

0.0 

Man-years 

34.2 

Lt 

Capt 

Maj 

LtCol 

Col 

4lxx 

ELECTRICAL  ENGINEERING 

Optimum:  per  yearl 

Optimal  Graduating  Class  Structure 

MS: 

62.4 

62.4 

0.0 

0.0 

0.0 

0.0 

PhD: 

10.4 

0.0 

10.4 

0.0 

0.0 

0.0 

Man-years 

125.0 

Lt 

Capt 

Maj 

LtCol 

Col 

Figure  4:  Typical  QuAM  Output 
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QuAM  OUTPUT 

The  purpose  of  this  section  is  to  verify  the  mathematical  formulation  of  the 
spreadsheet  based  QuAM.  This  is  accomplished  by  comparison  with  output  from  the 
EDFLOW  model.  Two  separate  runs  are  made  with  each  model.  The  first  run  is 
under  conditions  where  all  inventory  factors  are  set  to  1.0.  Inventory  factors  of  1.0 
are  used  because  Air  Force  personnel  managers  require  the  use  of  1 .0  inventory  factor 
values  in  the  EDFLOW  model,  until  further  research  is  accomplished  to  determine 


appropriate  inventory  factors.  The  second  run  is  made  with  inventory  factors  set  to 
1.0, 1.4,  and  1.2,  respectively,  for  BS,  MS,  and  PhD.  These  inventory  factor  values 
are  chosen  due  to  the  fact  that  the  initial  EDFLOW  formulation  was  accomplished 
with  the  inventory  factors  set  to  1.0, 1.4,  and  1.2.  Also,  the  respective  factors  are  well 
within  the  normal  range  discussed  in  Chapter  III,  and  portray  a  realistic  approach 
toward  personnel  modeling. 

Results  from  the  first  set  of  runs  are  presented  in  Table  21.  Notice  that  MS 
and  PhD  quotas  are  exactly  the  same  for  each  ASC.  Cost  in  the  EDFLOW  model  is 
different  from  the  man-years  determined  in  the  QuAM  model.  This  is  due  to  the  cost 


coefficient  change  that  was  introduced  in  Equation  (3-1). 

Table  21:  EDFLOW  vs.  QuAM — Inventory  Factors  Set  to  1.0 


ASC 

EDFLOW 

QuAM 

R 

MS 

PhD 

Cost 

MS 

PhD 

M-Yrs 

lAGE 

154 

16.7 

0.8 

18.3 

16.7 

0.8 

27.6 

OYEY 

190 

15.8 

3.5 

22.8 

15.8 

3.5 

34.2 

4Ixx 

590 

62.4 

10.4 

83.2 

62.4 

10.4 

124.8 
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Results  from  the  second  set  of  runs,  using  inventory  factors  of  1.0, 1.4,  and 
1.2,  are  presented  in  Table  22.  These  results  also  show  that  the  QuAM  output  is 
identical  to  that  achieved  by  EDFLOW.  Once  again,  notice  that  only  determined 
man-years  are  different. 

Table  22:  EDFLOW  vs.  QuAM — Inventory  Factors  Set  to  1.0, 1.4,  and  1.2 


ASC 

EDFLOW 

QuAM 

R 

MS 

PhD 

Cost 

MS 

PhD 

M-Yrs 

lAGE 

154 

23.2 

1.0 

25.2 

23.2 

1.0 

37.9 

OYEY 

190 

21.5 

4.2 

29.9 

21.5 

4.2 

44.8 

4Ixx 

590 

84.1 

12.5 

109.1 

84.1 

12.5 

163.8 

Each  of  the  26  ASCs  programmed  into  EDFLOW  and  QuAM  was  tested  and 
identical  results  were  achieved  in  every  case.  EDFLOW  and  QuAM  both  determine 
exactly  the  same  MS  and  PhD  quotas  when  given  identical  parameter  sets.  Therefore, 
it  can  be  assumed  that  QuAM,  the  spreadsheet  formulation  of  EDFLOW,  is 
mathematically  identical  to  its  parent  model.  This  means  that  the  same  results  are 
now  available  in  a  user-friendly,  point-and-click.  Excel  spreadsheet  environment. 


QuAM  INPUT  PARAMETER  SENSITIVITY 

This  section  of  research  is  dedicated  to  determining  input  factors  significant  to 
QuAM.  The  2*  factorial  experimental  design  developed  previously  is  used  in 
conjunction  with  a  VBA  subroutine  (Appendix  C)  to  exercise  the  experiment  and  to 
accomplish  the  required  32  runs  on  each  ASC.  Multiple-linear  regression  is  then 
accomplished  using  D  ATP  and  a  confidence  level  of  95  percent  to  determine  factors 
significant  to  the  model.  This  section  presents  general  results  for  all  ASCs,  and 
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specific  results  for  three  individual  ASCs  that  are  representative  of  the  entire  group  of 
26  ASCs.  The  three  ASCs  presented  are  1  AGE— Environmental  and  Engineering 
Management,  OYEY — Operations  Research,  and  4Ixx— Electrical  Engineering. 

The  2^  factorial  experimental  design  developed  in  Chapter  III  (Table  16)  is  the 
basis  for  the  sensitivity  analysis  that  is  presented  in  this  section  of  the  research.  The 
experiment  is  programmed  using  VBA,  and  is  accomplished  on  each  of  the  26  ASCs. 
Typical  experiment  results  are  shown  in  Table  23. 

I  begin  with  a  big  picture  look  at  the  sensitivity  analysis  accomplished  on  the 
26  ASCs.  QuAM  has  three  basic  outputs  that  are  analyzed  (MS  quota,  PhD  quota, 
and  man-years).  The  outputs  are  analyzed  individually,  using  the  2^  factorial 
experiment  (Table  23)  and  multiple-linear  regression. 

The  purpose  of  the  sensitivity  analysis  is  to  determine,  through  the  use  of 
multiple-linear  regression  and  a  95  percent  confidence  level,  which  of  the  five  input 
factors  is  significant  to  QuAM’s  output.  The  results  of  this  analysis  show  that  QuAM 
is  a  stable  model  that  reacts  to  changes  in  a  strictly  linear  manner,  with  no  spikes  or 
jumps.  Much  of  the  analysis  is  very  straightforward  and  expected.  For  instance,  yo  is 
not  significant  to  any  QuAM  output,  due  to  the  fact  that  there  is  no  BS  requirement. 
Another  expected  result  is  that  R  is  significant,  as  long  as  R  is  greater  than  zero,  to 
each  output.  An  example  of  this  can  be  seen  in  Figure  5,  which  contains  the  0  (Not 
significant),  1  (Significant)  plot  for  each  ASC  output  of  man-years  vs.  R. 
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Table  23:  Experiment  Results  (OYEY) 


Other  analysis  results  that  are  expected  include,  yi  is  always  significant  to  MS 
quota  and  y:  is  always  significant  to  PhD  quota,  as  long  as  the  degree  requirement  is 
greater  than  zero.  These  results  can  be  seen  in  the  0, 1  plots  presented  in  Figures  6 
and  7. 
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Man-years  vs.  Requirement 


Figure  5:  0, 1  Plot  -  Man-years  vs.  Requirement 


Figure  6:  0, 1  Plot  -  MS  Quota  vs.  MS  Inventory  Factor 


PhD  vs.  PhD  Inventory  Factor 


0  20  40  60  80  100  120 


PhD  Requirement 

Figure  7:  0, 1  Plot  -  PhD  Quota  vs.  PhD  Inventory  Factor 

One  result  that  was  not  expected  was  the  effect  of  attrition  on  the  model;  or  as 
it  should  be  said,  the  lack  of  attrition  effects  on  the  model.  Attrition  is  not  a 
significant  input  to  several  ASCs  as  a  whole,  and  is  not  significant  to  many  of  the 
individual  outputs  of  MS  quota,  PhD  quota,  and  man-years.  This  lack  of  effect  can  be 


44 


seen  in  Figures  8, 9,  and  10,  which  display  0,  1  plots  for  man-years  vs.  attrition,  MS 
quota  vs.  attrition,  and  PhD  quota  vs.  attrition. 


Figure  8:  0, 1  Plot  -  Man-years  vs.  Attrition 


Figure  9:  0, 1  Plot  -  MS  Quota  vs.  Attrition 


Figure  10:  0, 1  Plot  -  PhD  Quota  vs.  Attrition 
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Figures  8,  9,  and  10  provide  some  insight  into  when  attrition  is  significant  to 
the  model.  Basically,  it  can  be  seen  that  attrition  effect  can  be  broken  into  three 
general  cases:  (1).  Attrition  is  not  significant  to  any  ASC  output;  (2).  Attrition  is 
significant  to  every  ASC  output;  (3),  Attrition  is  not  significant  to  PhD  quota,  but  is 
significant  to  man-years  and  MS  quota.  The  three  cases  described  above,  are 
displayed  in  the  three  ASCs  chosen  as  representative  of  the  entire  group  and  are 
demonstrated  in  the  in-depth  analysis  of  the  representative  groups. 

Having  taken  a  big  picture  look  at  the  results,  now  let’s  look  into  the  details  of 
how  those  results  are  determined.  Recall  that  this  analysis  is  based  on  running  a  2^ 
factorial  experiment  on  the  ASC  and  then  using  the  experiment  results  in  a  multiple- 
linear  regression  to  determine  the  significant  effects.  Case  1  described  above,  is  seen 
in  the  4Ixx  ASC.  Figure  1 1  lists  the  results  obtained  for  the  4Ixx  ASC. 


4lxx 

Totals 

Factors 

MS 

PhD 

BS 

0 

a 

0 

0 

0 

MS 

477 

R 

1 

1 

1 

PhD 

113 

ro 

0 

0 

0 

590 

n 

1 

1 

0 

|l  =  significant 

_ n _ 

1 

1 

1 

Figure  11:  4Ixx  -  Significant  Factors 


The  4Ixx  ASC  has  an  MS  requirement  of 477  personnel  and  a  PhD 
requirement  of  1 13  personnel  for  a  comparatively  large  total  requirement  of  590 
personnel  with  AADs.  The  large  requirement  for  this  ASC  is  the  overriding  factor 
that  keeps  attrition  from  being  significant.  The  PhD  quota  regression  results  for  this 
ASC  are  used  as  an  example  and  are  seen  in  Figure  12.  Notice  that  attrition  is  not 
significant  to  the  PhD  quota  for  this  ASC.  This  can  best  be  visualized  by  looking  at 
the  effects  plot  associated  with  this  regression  in  Figure  13.  Attrition  appears  as  a 
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horizontal  line,  confirming  that  attrition  has  no  effect,  and  is  not  significant  to  the 
output.  It  is  also  clear  from  both  the  PhD  ANOVA  summary  output  (P-value  greater 
than  0.05  and  removed)  and  the  PhD  effects  plot  (horizontal  line)  that  MS  inventory 
factor  is  not  significant  to  the  PhD  quota.  The  MS  effects  plot  for  this  ASC  is  shown 
in  Figure  14  to  verify  that  attrition  is  not  significant  to  MS  quota  and  that  both  MS 
and  PhD  inventory  factors  are  significant. 


SUMMARY  OUTPUT  PHD  QUOTA 


Regression  Statistics 

Multiple  R 

0.9960 

R  Square 

0.9920 

Adjusted  R  Square 

0.9915 

Standard  Error 

0.2748 

Observations 

32.0000 

ANOVA 


df 

SS 

MS 

F 

Regression 

2 

272.4739 

136.2370 

1804.1525 

0.0000 

Residual 

29 

2.1899 

0.0755 

Total 

31 

274.6638 

Coefficients 

Standard  Error 

tStat 

P-value 

Intercept 

13.0519 

0.0486 

268.6812 

0.0000 

R 

1.3050 

0.0486 

26.8639 

0.0000 

n 

2.6099 

0.0486 

53.7274 

0.0000 

Figure  12;  4Ixx  ANOVA  -  PhD  Quota 
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Figure  14:  4Ixx  Effects  Plot  -  MS  Quota 


Case  2,  where  attrition  is  significant  to  each  of  the  ASC  outputs  is  displayed 
in  the  OYEY  ASC.  Results  for  the  OYEY  ASC  are  displayed  in  Figure  15.  Notice 
once  again,  that  R  and  /z  are  both  significant  to  each  output,  and  that  yi  is  significant 
to  both  man-years  and  MS  quota.  The  difference  between  this  and  the  4Ixx  ASC  is 
that  a  is  significant  to  each  output. 


OYEY 

Totals 

Factors 

Man-years 

MS 

PhD 

BS 

a 

1 

1 

1 

MS 

155 

R 

1 

1 

1 

PhD 

35 

Yo 

0 

0 

0 

190 

Yi . 

1 

1 

0 

|1  =  significant 

_ 2^ _ 

1 

1 

1 

Figure  15;  OYEY  -  Significant  Factors 


The  OYEY  ASC  has  an  MS  requirement  of  155  personnel  and  a  PhD 
requirement  of  35  personnel,  for  a  total  requirement  of  190  personnel  with  AADs. 
This  is  a  medium  size  requirement  for  both  MS  and  PhD,  with  a  PhD  requirement 
relative  to  the  MS  requirement  of  greater  than  10  percent.  The  average  requirements 
of  this  ASC  lend  attrition  some  degree  of  significance.  Although,  in  the  ANOVA 
summary  output  (Figure  16) « is  significant,  it  is  obvious,  by  looking  at  the  effects 
plot  for  the  regression  (Figure  17),  that  a  actually  has  very  little  effect  on  the  output. 
This  small  effect  is  noted  in  the  nearly  horizontal  line  on  the  effects  plot.  PhD  results 
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are  used  as  an  example.  The  MS  effects  plot  for  this  ASC  is  added  in  Figure  18  to 
verify  that  each  of  the  factors,  including  attrition  is  significant. 


[SUMMARY  OUTPUT  PHD  QUOTA 


Regression  Statistics 

Multiple  R 

0.9959 

R  Square 

0.9918 

Adjusted  R  Square 

0.9909 

Standard  Error 

0.0957 

Observations 

32.0000 

ANOVA 


df 

SS 

MS 

Regression 

3 

31.0139 

10.3380 

1129.2465  0.0000 

Residual 

28 

0.2563 

0.0092 

Total 

31 

31.2703 

Coefficients 

Standard  Error 

tStat 

P-vaiue 

Intercept 

4.3630 

0.0169 

257.9494 

0.0000 

a 

0.0810 

0.0169 

4.7910 

0.0000 

R 

0.4363 

0.0169 

25.7949 

0.0000 

n _ 

0.8788 

0.0169 

51.9558 

0.0000 

Figure  16:  OYEY  ANOVA  -  PhD  Quota 


Figure  18:  OYEY  Effects  Plot  -  MS  Quota 
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The  final  case,  where  attrition  is  significant  to  man-years  and  MS  quota  but 
not  significant  to  PhD  quota,  is  evident  in  the  1  AGE  ASC,  The  results  for  the  1  AGE 
ASC  are  listed  in  Figure  19.  Once  again,  R,  yi,  and  y2  follow  what  has  been 
demonstrated  in  each  of  the  preceding  examples.  However,  in  this  ASC  a  is 
significant  to  man-years  and  MS  quota  but  not  significant  to  PhD  quota. 


1AGE 

Totals 

Factors 

Man-years 

MS 

PhD 

BS 

0 

a 

1 

1 

0 

MS 

146 

R 

1 

1 

1 

PhD 

8 

_ ro 

0 

0 

0 

154 

_ ri 

1 

1 

0 

|1  =  Significant 

_ r2 

1 

1 

1 

Figure  19:  lAGE  -  Significant  Factors 


What  needs  to  be  noted  is  the  difference  between  the  MS  requirement  and  the 
PhD  requirement.  The  MS  requirement  is  almost  identical  to  that  of  the  OYEY  ASC, 
where  attrition  is  significant  to  each  of  the  outputs.  However,  the  PhD  requirement  is 
small  relative  to  the  MS  requirement  (less  than  10  percent).  Recall,  in  Figure  17,  that 
the  effect  plot  for  u  is  nearly  horizontal.  The  slight  difference  in  PhD  requirement 
eliminates  a  as  a  significant  effect  for  PhD  quota. 

Figures  20,  21,  and  22  show  the  ANOVA  summary  for  the  MS  quota,  the  MS 
effects  plot,  and  the  PhD  effects  plot  for  comparison  of  the  a  effect  line.  Note  the  P- 
value  for  attrition  is  less  than  0.05  (0.0129)  meaning  that  attrition  is  significant  to  MS 
quota.  However,  when  viewed  from  the  perspective  of  the  MS  effects  plot  (Figure 

21) ,  notice  that  the  attrition  effect  is  nearly  horizontal.  This  nearly  horizontal  line 
signifies  that  attrition  has  little  effect  on  MS  quota.  In  the  PhD  effects  plot  (Figure 

22) ,  the  attrition  effect  is  displayed  as  a  horizontal  line,  meaning  that  attrition  has  no 
effect  and  is  not  a  significant  factor  to  PhD  quota  determination. 
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SUMMARY  OUTPUT  MS  QUOTA 

Regression  Statistics 

Multiple  R 

R  Square 

Adjusted  R  Square 
Standard  Error 
Observations 

0.9961 

0.9921 

0.9910 

0.4354 

32.0000 

ANOVA 

df 

SS 

MS 

F 

Significance  F 

Regression 

4 

645.9824 

161.4956 

852.0751 

0.0000 

Residual 

27 

5.1174 

0.1895 

Total 

31 

651.0997 

Coefficients 

Standard  Error 

tStat 

P-value 

Intercept 

20.8879 

0.0770 

271.4112 

0.0000 

a 

0.2049 

0.0770 

2.6628 

0.0129 

R 

2.0888 

0.0770 

27.1411 

0.0000 

Yi 

3.9671 

0.0770 

51.5469 

0.0000 

Xl _ 

0.2105 

0.0770 

2.7353 

0.0109 

Figure  20:  lAGE  ANOVA  -  MS  Quota 


Figure  21 :  1  AGE  MS  Effects  Plot  Figure  22;  1  AGE  PhD  Effects  Plot 


This  section  demonstrated  that  the  factors  R,  yi,  and  yi  are  always  significant 


to  the  QuAM  output.  It  is  expected  that  requirements  are  significant  to  each  output, 
because  the  requirements  are  what  drive  the  model  to  determine  a  steady-state  quota 
necessary  to  maintain  that  particular  requirement.  The  significance  of  the  inventory 
factors  is  also  expected.  The  inventory  factor  is  basically  just  a  number  used  to  scale 
the  requirement  to  maintain  a  useable  inventory  of  personnel  above  what  is  actually 
needed.  Therefore,  it  makes  sense  that  the  MS  and  PhD  inventory  factors  are 
significant  to  QuAM’s  output. 
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The  effect  of  a  is  the  main  thrust  of  this  section.  Attrition,  unexpectedly, 
plays  a  small  role  in  QuAM  output.  In  the  mathematical  formulation,  attrition  is  the 
factor  that  causes  experienced  personnel  to  leave  the  system  and  to  be  replaced  by 
junior  personnel  entering  the  system  without  advanced  education  or  years  of  service. 
However,  when  comparing  the  small  changes  made  in  the  LHS  by  attrition  to  the 
large  changes  made  to  the  RHS  by  requirement  and  inventory  factor,  it  becomes 
obvious  that  attrition  effect  is  easily  overshadowed  by  the  larger  effects  of 
requirements  and  inventory  factor.  Attrition  is  not  always  significant  to  QuAM’s 
output,  as  discussed  in  the  three  cases  above.  Even  when  attrition  is  a  significant 
factor,  its  effect  on  the  output  of  the  model  is  negligible. 

QuAM  COST  COEFFICIENT  SENSITIVITY 

This  section  contains  a  discussion  on  the  sensitivity  analysis  results  obtained 
by  systematically  varying  the  cost  coefficients  of  the  objective  function  [Equation  (3- 
1)].  A  2^  factorial  design  is  used,  as  was  previously  developed  in  Chapter  HI  (Tables 
18, 19,  and  20).  Results  of  one  representative  ASC  are  presented  and  discussed  in 
detail.  One  ASC  is  used,  due  to  the  fact  that  each  of  the  ASCs  display  the  same 
behaviors  when  cost  coefficients  are  varied. 

Recall,  in  Equation  (3-1),  that  the  objective  function  for  QuAM  has  a  man- 
year  cost  associated  with  MS  quota  and  a  man-year  cost  associated  with  PhD  quota. 
With  just  two  cost  coefficients  to  vary,  a  simple  2^  factorial  experiment  is  used  to 
determine  model  sensitivity  to  changes  in  the  cost  function.  This  methodology  is 
developed  in  Chapter  HI.  The  experiment  used  is  presented  in  Table  18.  Typical 


52 


results  for  this  experiment  are  displayed  in  Table  24.  Notice  that  an  additional  run  is 

# 

made  at  the  center  point  for  comparison.  The  addition  of  the  center  point  to  the 
experiment  has  no  effect  on  the  results  of  the  regression,  due  to  the  zeros  in  the 
columns. 


Table  24:  2^  Experiment  Results  -  OYEY 


Run  # 

MS  Cost 

PhD  Cost 

MS  Quota 

PhD  Quota 

Man-Years 

1 

0 

0 

15.84 

3.49 

34.22 

2 

1 

1 

3.51 

53.54 

3 

1 

-1 

15.47 

46.11 

4 

-1 

1 

15.96 

3.43 

5 

-1 

-1 

15.96 

3.43 

14.85 

First,  just  looking  at  the  results,  it  can  be  seen  that  there  is  little  effect  noticed 
by  changing  the  cost  coefficients.  This  small  change  can  best  be  viewed  by  looking 
at  Figure  23.  Figure  23  is  a  bar  chart  that  compares  MS  quota  and  PhD  quota  at  each 
of  the  experimental  design  points.  Notice  that  the  changes  at  each  design  setting  are 
almost  indiscernible. 


Figure  23:  Bar  Chart  -  OYEY  Cost  Results 


Next,  look  at  the  multiple-linear  regression  results  for  this  2^  factorial 
experiment.  Keeping  in  mind  the  results  presented  in  Table  24  and  Figure  23,  it  is 
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expected  that  MS  cost  and  PhD  cost  will  not  be  significant  factors  in  determining 
quotas.  However,  costs  will  be  significant  to  man-years  determined  because  there  is  a 
direct  relationship  between  the  cost  coefficients  used  in  Equation  (3-1)  and  the  man- 


years  determined  by  QuAM. 

The  ANOVA  summary  outputs  for  MS  quota  and  man-years  are  seen  in 
Figures  24  and  25.  The  ANOVA  summary  output  for  PhD  quota  is  identical  to  the 
MS  quota  summary  and  is  not  shown.  In  Figure  24,  note  that  ‘Significance  F’  is 
0. 1814,  meaning  that  this  is  not  a  significant  model.  A  ‘Significance  F’  value  greater 
than  0.05  also  signifies  that  each  of  the  factor  coefficients  is  approximately  zero,  and 
that  only  the  intercept  is  significant  to  the  model.  This  is  also  seen  in  the  ‘P-values’. 
Both  the  MS  cost  and  the  PhD  cost  ‘P-values’  are  greater  than  0.05,  and  therefore  are 


not  significant.  In  Figure  25,  note  the  ‘Significance  F’  is  less  than  0.05,  denoting  a 


significant  model,  and  that  both  MS  and  PhD  costs  are  significant  factors  (P-values 


less  than  0.05)  to  man-year  determination. 


SUMMARY  OUTPUT  MS  QUOTA 


1  Regression  Statistics 

Multiple  R 

R  Square 

Adjusted  R  Square 

Standard  Error 

Observations 

5.0000 

ANOVA 


df 

SS 

MS 

F 

Significance  F 

Regression 

2 

0.1336 

0.0668 

4.5114 

0.1814 

Residual 

2 

0.0296 

0.0148 

Total 

4 

0.1632 

Coefficients 

Standard  Error 

tStat 

P-value 

Intercept 

15.8062 

0.0544 

290.4471 

0.0000 

MS  Cost 

-0.1623 

•  0.0608 

-2.6667 

0.1165 

PhD  Cost 

0.0841 

0.0608 

1.3825 

0.3009 

Figure  24:  OYEY  ANOVA  -  MS  Quota 
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SUMMARY  OUTPUT  MAN-YEARS 


1  Regression  Statistics 

Multiple  R 

1.0000 

R  Square 

0.9999 

Adjusted  R  Square 

0.9998 

Standard  Error 

0.2268 

Observations 

5.0 

^OVA 


df 

SS 

MS 

F 

Regression 

2 

1046.0286 

523.0143 

10171.7558 

0.0001 

Residual 

2 

0.1028 

0.0514 

Total 

4 

1046.1314 

Coefficients 

Standard  Error 

tStat 

P-vaiue 

Intercept 

34.0888 

0.1014 

336.1541 

0.0000 

MS  Cost 

15.7709 

0.1134 

139.1002 

0.0001 

PhD  Cost 

3.5757 

0.1134 

31.5379 

0.0010 

Figure  25:  OYEY  ANOVA  -  Man  -years 


This  portion  of  the  research  determined  that  the  QuAM  outputs  of  MS  quota 
and  PhD  quota  are  not  sensitive  to  changes  in  the  cost  coefficients.  Of  course  man- 
years,  the  cost  determined  by  QuAM,  is  sensitive  to  changes  in  the  cost  vector.  A 
simple  2^  factorial  experiment  was  used  along  with  multiple-linear  regression  to 
determine  results.  Recall,  from  Equation  (3-1),  that  QuAM  sums  the  number  of 


personnel  needed,  without  regard  to  military  grade  or  longevity.  The  fact  that  just 
two  costs  are  applied,  regardless  of  military  grade,  in  QuAM  makes  the  results  of  this 
portion  of  the  analysis  fairly  obvious.  Future  research  may  be  needed  to  determine 
the  effects  of  applying  an  individual  cost  to  each  military  grade. 

This  chapter  was  centered  on  presenting  the  results  of  the  QuAM  analysis, 
using  the  methodology  developed  in  previous  chapters.  The  output  of  QuAM  was 
compared  with  EDFLOW,  its  parent  model,  and  determined  to  be  mathematically 
identical.  Sensitivity  analysis  was  conducted  using  factorial  experiments  and 
multiple-linear  regression  to  vary  the  LHS,  RHS,  and  the  cost  coefficients.  Input 
factors  significant  to  QuAM’s  output  were  then  determined.  QuAM  displayed  simple 


linear  characteristics  throughout  the  analysis,  and  performed  without  spikes  or  jumps 
regardless  of  the  input  factor  values  used. 

QuAM  is  now  transported  to  a  spreadsheet  environment  and  analyzed.  The 
final  chapter  of  this  research  provides  recommendations  for  implementation  and  for 
further  research.  Concluding  remarks  are  also  provided. 
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CHAPTER  V 


RECOMMENDATIONS  and  CONCLUSION 

mTRODUCTION 

QuAM  is  now  transported  to  an  Excel  spreadsheet  environment,  where  it 
provides  the  same  MS  and  PhD  quotas  as  the  FORTRAN  77  EDFLOW  formulation, 
QuAM  is  a  well-behaved,  linear  mathematical  model.  It  has  been  tested  for 
sensitivity  to  the  input  factors  of  attrition,  requirement,  and  inventory  factors,  and  has 
displayed  simple  linear  tendencies  with  no  large  spikes  or  jumps  at  any  input  factor 
value  settings. 

This  final  chapter  begins  with  a  review  of  the  basic  assumptions  behind  the 
QuAM  model.  With  those  assumptions  in  mind,  recommendations  for  model 
implementation  are  made.  During  the  course  of  this  research,  areas  requiring 
additional  emphasis  have  been  found,  leading  to  recommendations  for  further 
research. 

ASSUMPTIONS 

Recall  that  QuAM  is  based  on  a  Markov  decision  process.  The  assumptions 

basic  to  the  QuAM  model  are  driven  by  that  process,  and  are  summarized  below.  The 

key  to  each  of  these  assumptions  is  that  QuAM  assumes  a  steady-state  environment. 

1 .  Personnel  within  an  academic  specialty  are  statistically  identical  and  behave 
independently — QuAM  determines  quotas  for  academic  specialties  based  on 
identically  qualified  individuals.  The  actions  of  one  of  those  identical 
individuals  has  no  affect  on  the  rest,  i.e.,  the  attrition  of  one  individual  does 
not  trigger  a  mass  attrition  in  that  identical  group  of  individuals. 
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2.  The  average  size  and  distribution  of  the  overall  population  within  a  specialty 
remains  constant — assumes  an  unchanging  requirement  for  that  specialty  and 
that  steady-state  is  maintained.  This  can  be  related  to  assumption  one  above, 
in  that  there  are  no  large  changes  in  numbers  of  personnel. 

3 .  Future  attrition  probabilities  are  determined  by  current  longevity  and  degree 
level — assumes  that  attrition  is  based  solely  on  years  of  service  and  degree 
level.  Currency  of  the  degree  is  disregarded. 

4.  All  graduate  programs  are  completed  successfiilly — assumes  a  100  percent 
graduation  rate,  and  that  no  attrition  occurs  during  training. 

5.  Grade  requirements  can  be  satisfied  only  by  educationally  qualified  personnel 
with  appropriate  longevity — assumes  that  lieutenant  billets  are  filled  by 
lieutenants,  captain  billets  by  captains,  etc. 

6.  AFPC  is  100  percent  effective  in  assigning  personnel  with  AADs  to 
appropriate  billets — assumes  that  personnel  with  required  AADs  are  assigned 
to  AAD  billets.  This  assumption  does  not  account  for  operational  assignments 
or  for  professional  military  education. 

7.  Degrees  are  always  valid  once  obtained — individuals  with  required  degrees, 
remain  part  of  the  useable  inventory  until  they  are  removed  by  attrition.  Once 
again,  this  assumes  that  trained  individuals  are  always  available  and  assigned 
to  their  academic  specialty,  until  leaving  the  system. 

8.  All  model  parameters  are  assumed  to  be  constant — each  of  the  input  factor 
values  (attrition,  requirement,  and  inventory  factors)  are  unchanged 
throughout  the  23  years  encompassed  by  the  run  of  the  model.  Once  again, 
the  assumption  of  steady-state  is  present. 


RECOMMENDATIONS 

It  is  apparent  from  the  assumptions  above  that  QuAM  actually  determines  a 
minimum  quota  allocation  for  each  ASC.  The  quota  allocation  is  a  minimum  due  to 
the  fact  that  QuAM  assumes  steady-state  input  parameters,  perfect  personnel 
management,  and  constant  availability  of  personnel  with  required  AADs  to  fill  AAD 
billets.  Recall  from  our  findings  in  Chapter  IV,  that  QuAM  is  dependent  on  accurate 
AAD  requirement  information  and  inventory  factor  values,  but  is  not  sensitive  to 
changes  in  attrition. 
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QuAM  as  it  stands  now  is  an  excellent  personnel  management  tool.  It 
provides  the  minimum  annual  quota  allocation  by  grade  that  is  required  to  maintain 
the  steady-state  requirements  of  a  given  ASC.  QuAM,  at  its  best,  should  be  used  by 
personnel  managers  to  determine  a  minimum  annual  allocation  of  personnel  for  each 
ASC.  That  determined  allocation  should  be  educated  by  AFIT  or  AFIT-sponsored 
programs  yearly.  Educating  this  minimum  quota  should  ensure  that  the  AAD  needs 
of  the  Air  Force  are  continually  met  and  that  all  available  AAD  personnel  billets  are 
able  to  be  manned  with  qualified  individuals. 

The  sensitivity  analysis  effort  accomplished  on  QuAM  has  led  to  some  areas 
that  require  additional  research.  They  are: 

1 .  QuAM  is  sensitive  to  the  input  requirements.  Recall  that  the  individual 
ASC  requirements  are  maintained  by  the  ASMs.  The  fact  that  AAD 
requirements  are  the  driving  factor  in  QuAM  quota  determination,  and  that 
requirements  are  assumed  to  be  constant,  emphasizes  the  necessity  of  an 
accurate  requirement  database.  Specifically,  research  is  needed  to  develop 
how  requirements  are  determined  and  how  they  are  maintained. 

2.  The  inventory  factors  built  into  the  model  allow  QuAM  to  provide  an 
additional  on-hand  inventory  of  trained  personnel.  This  additional 
inventory  is  necessary  to  allow  personnel  to  attend  professional  military 
education,  to  be  assigned  to  operational  billets,  and  to  provide  an  overlap 
of  experienced  personnel  to  enhance  moves  between  billets.  Research  is 
needed  to  determine  accurate  inventory  factor  values  to  be  used  within 
QuAM.  Accurate  inventory  factor  values  will  allow  personnel  managers 
additional  latitude  by  determining  an  annual  allocation  quota  that  will 
maintain  a  steady-state  inventory  of  trained  personnel  above  what  is 
required  by  the  baseline  AAD  requirement. 

3.  QuAM  is  currently  not  sensitive  to  changes  in  the  costs  to  produce  MS 
degrees  and  PhD  degrees.  The  cost  function  in  QuAM  is  based  on  man- 
years  and  treats  all  personnel,  regardless  of  grade  and  longevity, 
identically.  It  is  possible  that  man-years  are  not  the  only  cost  incurred  by 
educating  personnel.  A  relative  cost  by  grade  and/or  longevity  may  be 
more  usefUl  to  QuAM  and  its  optimization  processes.  Additional  research 
is  needed  to  determine  if  a  change  to  the  cost  function  actually  is 
significant  to  the  annual  quota  allocations  determined. 
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CONCLUSION 


The  QuAM  model  is  a  two-phase  mathematical  model  based  on  a  Markov 
decision  process  that  is  used  to  feed  a  linear  optimization.  Outputs  from  the  model 
provide  the  minimum  number  of  officers,  by  grade  and  academic  specialty,  which 
must  be  educated  yearly  to  fill  validated  AAD  billets.  Inputs  to  the  model  include 
required  AAD  billets,  by  rank  and  degree  level  for  each  Air  Force  ASC,  attrition 
rates,  and  inventory  factor  values.  QuAM  was  originally  coded  in  FORTRAN  77  and 
was  designed  to  meet  the  specific  objectives  of  an  AFIT  initiative. 

This  research  effort  focused  on  the  QuAM  model  and  the  creation  of  a  user- 
friendly  tool.  The  model  was  transported  from  FORTRAN  77  to  an  Excel 
spreadsheet  environment  that  uses  a  combination  of  Excel,  VBA,  and  Excel  Solver 
’97  to  accomplish  the  data  display,  manipulation,  and  optimization.  The  majority  of 
this  research  was  centered  on  testing  the  model  for  sensitivity  to  variations  in  its  five 
input  factors.  This  sensitivity  analysis  was  accomplished  using  a  2^  factorial 
experiment  and  multiple-linear  regression.  Each  of  the  input  factors  was  tested  for 
significance,  using  a  95  percent  confidence  level,  against  the  model  outputs  of  MS 
quota,  PhD  quota,  and  man-years. 

The  results  of  this  research  show  that  QuAM  has  been  transported 
successfully  to  the  user-friendly,  point-and-click,  environment  of  the  Excel 
spreadsheet.  The  spreadsheet  formulation  matches  the  FORTRAN  77  formulation 
identically  in  each  of  the  26  ASCs  tested.  QuAM  performs  in  a  strictly  linear  manner 
without  spikes  or  jumps.  QuAM  is  sensitive  to  input  AAD  requirements,  and  to  the 
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inventory  factor  values  used.  Surprisingly,  QuAM  is  not  sensitive  to  changes  in 
attrition. 

QuAM  is  ready  to  be  used  by  personnel  managers.  It  should  be  used  to 
provide  an  annual  minimum  allocation  of  officers,  by  grade,  that  need  to  be  trained  by 
AFIT  or  AFIT-sponsored  programs.  QuAM  is  a  tool  waiting  for  use.  Its  use  should 
help  managers  determine  quotas  that  will  continually  meet  the  needs  of  the  Air  Force, 
now  and  in  the  future,  in  each  of  the  academic  specialties. 


61 


APPENDIX  A;  EDFLOW 


Program  EdFIow 


c  Determines  annual  minimum  numbers  of  academic  program  entries  c 
c  needed  to  meet  stable  personnel  requirements  (given  by  degree  c 
c  level  and  grade)  based  on  estimated  attrition  probabilities  c 
c  (given  by  degree  level  and  longevity) .  c 
c  Calls  IMSL  subroutine  DLPRS  to  solve  a  linear  program.  c 


dimension  A(200, 200) , B (200) , C (200) , IRTYPE (200) ,XLB(200) , 

&  XUB(200) ,X(200) ,DSOL(200) ,Req(3,5) ,Att(22^3) .Scale (3) 

character'*^4  Code. Query 

common  /worksp/  rwksp 
real  rwksp (27762) 
call  iwkin (27762) 

open (11. file=  *  edflow.dat  * . status=  *  old* ) 
open(12.file=*edflow.out* . status=*new* ) 
read (11.*)  (Att (I. 1) . 1=1.22) 
read (11.*)  (Att (1.2) .1=2.22) 
read (11.*)  (Att (I. 3) .1=5.22) 
readdl.*)  Scale(l) 
read ( 11. * )  Scale (2 ) 
read(ll.*)  Scale(3) 

print*. *  Enter  Desired  Ed  Code  (all=****):* 
read (*.5)  Query 
1  read (11. 5)  Code 

5  format  (A4 ) 

if  ( Code. ne. *  DONE* )  then 
do  10  1=1.3 

readdl.*)  (Req(I.  J)  .  J=1.5) 

10  continue 

i f  ( Req (3.1) . ne . 0 . 0 )  then 

Req (3. 2 ) =Req (3. 2) +Req (3. 1) 

Req (3. 1) =0 . 0 
endif 
if 

( ( ( Query (l:l).eq.***).or.( Query (1:1) . eq . Code (1:1))). and . 

&  ( (Query (2:2)  .eq. **  * )  .or.  (Query (2:2) .eq.Code (2:2) ) ) .and. 

&  ( (Query (3 : 3) . eq. *  *  * ) .or.  (Query (3:3) . eq.Code (3:3))). and. 

&  ( (Query ( 4 ; 4 )  . eq. *  *  * ) . or .  (Query ( 4 : 4 ) . eq. Code (4 : 4 ) ) ) )  then 

do  20  1=1.200 
B(I)=0.0 
IRTYPE(I)=0 
C(I)=0.0 
X(I)=0.0 
XLB(I)=0.0 
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15 

20 


25 


30 


35 


40 


45 


50 


55 


60 


65 


70 


85 

90 

95 


XUB(I)=-1.0E30 
DSOL(I)-0.0 
do  15  J=l,200 
A(I,  J)=0.0 
continue 
continue 
Cost=0. 0 
M=139 
N=166 

A(2,l)=1.0 
do  25  1=2,23 

A(I+l,I)=1.0-Att (1-1,1) 

A(l,I)=Att (1-1,1) 
continue 
A(l,24)=1.0 
do  30  1=25,46 

A(I+22,I)=1.0 
continue 
do  35  1=47,67 

A(I+1, I) =1-Att (1-45,2) 

A(l,I)=Att (1-45,2) 
continue 
A(l,68)=l 
do  40  1=69,106 

A(I+19,I)=1.0 
continue 
do  45  1=107,124 

A(I+1, I) =1-Att (1-102,3) 

A(l,I)=Att(I-102,3) 
continue 
A(l,125)=1.0 
do  50  1=126,147 

A(I-101,I)=1.0 
continue 
do  55  1=148,166 
A(I-79,I)=1. 0 
continue 
do  60  1=1,125 
A(I,I)=-1.0 
continue 
do  65  1=1,22 

A(I,I+125)=-1.0 
continue 
do  70  1=47,65 

A(I,I+101)=-1.0 
continue 
do  95  1=1,3 

do  90  J=l,5 

do  85  K=I,3 

B(124+(I-1)*5+J)= 

B(124+(I-1) *5+J) +Req(K, J) *Scale(K) 
continue 
continue 
continue 
do  100  1=125, M 
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IRTYPE(I)=2 

100  continue 

do  105  1=1,200 
A(125,I)=0.0 
105  continue 

call  PutOne (125, 1, 4, A) 
call  PutOne ( 125, 47, 4 8, A) 

call  PutOne (126, 5, 11, A) 
call  PutOne ( 126, 49, 55, A) 
call  PutOne (126, 107, 112, A) 

call  PutOne (127, 12, 16, A) 
call  PutOne ( 127, 56, 60, A) 
call  PutOne(127,113,117,A) 

call  PutOne(128,17,20,A) 
call  PutOne (128, 61, 64, A) 
call  PutOne (128, 118, 121, A) 

call  PutOne (129, 21, 24, A) 
call  PutOne (129, 65, 68, A) 
call  PutOne ( 129, 122 , 125, A) 

call  PutOne (130, 47, 48, A) 

call  PutOne ( 131, 49, 55, A) 
call  PutOne (131, 107, 112, A) 

call  PutOne ( 132 , 56, 60, A) 
call  PutOne (132, 113, 117, A) 

call  PutOne (133, 61, 64, A) 
call  PutOne (133, 118, 121, A) 

call  PutOne ( 134, 65,  68 , A) 
call  PutOne (134, 122, 12 5, A) 

call  PutOne (136, 107, 112, A) 
call  PutOne (137, 113, 117, A) 
call  PutOne(138,118,121,A) 
call  PutOne (139, 122, 125, A) 

do  110  1=25,46 
C(I)=1.0 

110  continue 

do  115  1=69,87 
C ( I ) =2 . 0 

115  continue 

call  DLPRS (M,N, A, 200, B, B, C, IRTYPE, XLB,XUB, Cost,X, DSOL) 
write (12,120)  Code 

120  format (’!*,//////*  REQUIREMENTS:  ',A4) 

write ( 12, 125) 

125  format  (/IX,  *  LT  CPT  MAJ  LTC  COLM 
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130 

135 


140 

145 

147 

148 
150 
155 
160 

format  {/4X,  *LT*,17X,  *CPT»,32X,  *MAJ*,22X,  *LTC*,17X,  *COL*) 


205 

write (12, 205)  (1,1=0,23) 

format ( IX, 2415) 

210 

write (12,*) 

write (12, 210)  (X (I ) +X (1+125) ,1=1,22) ,X{23) ,X(24) 
format (IX, 24F5.1, ’  BS ’ ) 

215 

write (12,*) 

write (12, 215)  (X (I ) , 1=25, 46) 
format ( 6X, 22F5 . 1) 

220 

write ( 12,  * ) 

write (12, 220)  (X (I) +X (I+lOl) ,1=47,65)  ,  (X (I ) , 1=66, 68 
format ( IIX, 22F5 . 1, *  MS’) 

225 

write ( 12, * ) 

write (12, 225)  (X (I ) , 1=69, 87 ) 
format ( 16X, 19F5 , 1) 

230 

write ( 12,  * ) 

write (12,230)  (X (I) , 1=88, 106) 
format (21X, 19F5 . 1) 

235 

write ( 12, *) 

write (12,235)  (X (I ), 1=107, 125) 
format (26X,19F5.1, *  PHD* ) 

237 

write (12,*) 

write (12,237)  SumX(126, 147, X) 
f ormat ( *  Annual  MS  (m) :  *,F5.1) 

238 

write (12,238)  SumX (148, 166, X) 
format ( ’  Annual  PHD  (p) :  ’,F5.1) 

240 

write (12,240)  Cost 
f ormat ( *  Cost  (m+2p) :  *,F5.1) 

write (12,245) 

write(12,130)  »  BS  (Req { 1, J) , J=l, 5 ) ,  SumR{l,Req) 

write(12,130)  *  MS  * ,  (Req  (2,  J)  ,  J=l,  5)  ,  SuinR(2,Req) 
write(12,130)  *  PHD*,  (Req (3, J) , J=l, 5) ,  SumR{3,Req) 

format (A4, 5F7 . 1, Fll • 1, 4F7 . 1,  Fll . 1) 
write (12, 135) 

format (/*  INVENTORY  FACTOR’) 
write (12, *) 

write(12,130)  ’  BS  *,  Scaled) 

write ( 12, 130)  *  MS  ’ ,  Scale (2) 

write (12, 130)  ’  PHD’,  Scale (3) 

write (12, 140) 
format  (/’  ATTRITION*) 
write (12, *) 

write(12,145)  (1,1=1.22) 

format ( 6X, 2215) 

write (12, 147)  (Att (I, 1) , 1=1, 22) 
format (6X,22F5. 2, ’  BS * ) 

write(12,148)  (Att (I, 2 ), 1=2, 22) 
format (11X,21F5. 2, *  MS’) 

write (12, 150)  (Att (I, 3 ), 1=5, 22 ) 
format (26X,18F5. 2, *  PHD*) 

write(12,155) 

format (//*  PRIMAL  SOLUTION’) 
write (12, 160) 
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245 

INVENTORY  *  ) 

247 

& 

& 

& 

& 

& 

& 

& 

248 

249 

& 

250 


format (//*  DUAL  SOLUTION 34X, *  STEADY- STATE 


write (12, 247) 

format  (/IX,  »  LT  OPT  MAJ  LTC  COL», 

IX,'  LT  CPT  MAJ  LTC  COL*) 

write(12,248)  *  BS  *,  (DSOL ( I ) , 1=125, 129) , 

SumX(l,4,X) ,SumX (5,11, X) ,SumX( 12,16, X) , 
SumX(17,20,X)  ,SumX  (21,24, X)  ,SuinX(  1,24, X) 
write(12,248)  *  MS  *,  (DSOL ( I ), 1=130, 134 ) , 

SuraX(47,48,X) , SumX (49, 55,X) , SumX (56, 60,X) , 
SumX(61,64,X) ,SumX( 65,68, X) ,SumX( 47,68, X) 
write(12,248)  *  PHD*,  (DSOL ( I ), 1=135, 139 ) , 

0. 0, SumX (107, 112, X) , SumX ( 113, 117 ,X) , 

SumX  (118, 121, X)  ,  SumX  (122, 125, X)  ,  SumX  (107, 125, X) 
format  ( A4 , 5F7 . 2 , FI 4 . 1 , 4 F7 . 1 , 4 FI 1 . 1 ) 
write (12, 249) 

format (//*  THIS  SOLUTION  STRICTLY  ENFORCES  GRADE* 

,*  REQUIREMENTS*) 
write (*,250)  Code 
format  ( *  Done  with  * , A4 ) 
endif 


goto  1 
endif 


close (11) 
close  ( 12 ) 
end 


subroutine  PutOne (I , J, K, A) 
dimension  A (200, 200) 
do  300  L=J,K 
A(I,L)=1.0 
300  continue 

return 
end 

function  SumX(I,J,X) 
dimension  X(200) 

SumX=0 . 0 
do  305  K=I,J 

SumX=SumX+X(K) 

305  continue 

return 
end 

function  SumR(I,Req) 
dimension  Req(3,5) 

SumR=0 

do  310  J=l,5 

SumR=SumR+Req  ( I ,  J) 

310  continue 

return 
end 
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APPENDIX  B;  OuAM 


Instructions  Worksheet 


WELCOME  TO  THE  QUOTA  ALLOCATION  SPREADSHEET  MODEL. 

The  solutions  developed  by  this  model  strictly  enforce  grade  requirements. 

There  are  only  five  factors,  which  should  be  updated  on  the  Master  Worksheet. 

1.  Attrition  Factor:  This  factor  was  built  into  the  model  as  a  means  to  vary  attrition, 
without  changing  the  baseline  attrition  data. 

*** Attrition  factor  will  normally  be  set  to  i.o*** 

Baseline  attrition  data  can  be  changed  only  on  the  Attrition  Worksheet. 

2.  Requirements  Factor:  This  factor  was  built  into  the  model  as  a  means  to  vary  the 
requirements  without  changing  the  baseline  requirements. 

***Requirements  factor  will  normally  be  set  to  i.o*** 

Baseline  requirement  data  can  be  changed  only  on  the  Requirements 
Worksheet. 

3.  Inventory  Factors  (3):  These  factors  are  used  to  maintain  an  inventory  of  personnel 
above  the  baseline  requirement. 

a.  BS~lnventory  Factor  for  BS  Degrees.  Will  normally  be  set  to  1 .0,  but  can 
be  set  to  any  value  because  there  is  no  BS  requirement. 

b.  MS-Inventory  Factor  for  MS  Degrees.  ***Normal  values  - 1.0  to  1.5*** 

c.  PhD— Inventory  Factor  for  PhD  Degrees.  ***Normal  values  —1.0  to  1.5*** 

After  updating  Factors  to  required  values,  click  the  run  button.  The  program  will 
automatically  load  the  requirements  for  each  of  the  ASCs 

and  solve  for  the  annual  optimal  number  of  MS  and  PhD  quotas  by  grade. 
***Requlres  approximately  20  seconds  per  ASC*** 

To  view  the  formulation  of  an  individual  solution,  you  will  need  to  Run  the  MACRO  for 
that  ASC. 


There  is  a  MACRO  for  each  of  the  ASCs.  The  MACROS  are  listed  by  name 
rather  than  4  digit  code  due  to  VBA  constraints. 

Once  the  solution  is  reached,  select  the  Individual  Tab  to  view  the 
formulation  and  solution. 


67 


Master  Worksheet  (Partial) 

Quota  Allocation  Model:  This  Solution  Strictly  Enforces  Grade  Requirements. 


THIS  IS  THE  ONLY  COLOR  CELL  THAT  CAN  BE  CHANGED  IN  THIS  WORKBOOK*** 


Attrition  Factor:  |  1.00 

I  ***Onl] 

f  These  Five  Cells  Should  Be  Updated  on  this  Worksheet' 

Requirements  Factor: 

Inventory  Factors:  I  BS; 

I  1.00  1 

***  AFTER  UPDATING  THE  APPROPRIATE  CELLS,  SELECT  THE  RUN  MACRO  FOR  ALL*** 

***TO  SEE  AN  INDIVIDUAL  ED  CODE,  UPDATE  THE  APPROPRIATE  CELLS,  SELECT  THE  INDIVIDUAL  MACRO*** 


[Varied  by  solver.  |Determlned  by  formula.  [Used  to  change  parameters  | 


1  4Axx  1  Aeronautical  Engineering  1 

lOptImum:  per  year! 

0 

ptimal  Graduating  Class  Structure  j 

1  1 

25.2 

25.2 

0.0 

0.0 

0.0 

0.0 

PhD: 

6.2 

0.0 

6.2 

0.0 

0.0 

0.0 

56.5 

Lt 

Capt 

LtCol 

Col 

1  4Bxx  1  Aerospace  Engineering  I 

0 

ptimal  Graduating  Class  Structure  j 

MS: 

2.1 

1.0 

0.8 

0.3 

0.0 

0.0 

PhD 

0.5 

0.0 

0.5 

0.0 

0.0 

0.0 

Manyears 

4.7 

Lt 

Capt 

MaJ 

LtCol 

Col 

1  4Exx  1  Astronautical  Engineering  j 

O 

ptimal  Graduating  Class  Structure  I 

MS: 

9.8 

9.8 

0.0 

0.0 

0.0 

0.0 

PhD: 

1.3 

0.0 

1.3 

0.Q 

0.0 

0.0 

Manyears; 

18.8 

Lt 

Capt 

MaJ 

LtCol 

Col 

1  4lxx  1  Electrical  Engineering  | 

Oj 

ptimal  Graduating  Class  Structure  I 

MS: 

62.4 

62.4 

0.0 

0.0 

0.0 

0.0 

PhD: 

10.4 

0.0 

10.4 

0.0 

0.0 

0.0 

125.0 

Lt 

'm>mm 

LtCol 

Col 

1  4Mxx  1  Mechanical  Engineering  | 

O 

ptimal  Graduating  Class  Structure  I 

1  i 

11.5 

11.5 

0.0 

0.0 

0.0 

0.0 

PhD: 

2.5 

0.0 

2.5 

0.0 

0.0 

0.0 

24.9 

Lt 

wmm 

LtCol 

Col 

1  4Qxx  1  Nuclear  Engineering  i 

lOptimum:  per  year! 

0 

ptimal  Graduating  Class  Structure  | 

MS: 

4.8 

2.0 

2.3 

0.0 

0.5 

0.0 

PhD: 

1.0 

0.0 

1.0 

0.0 

0.0 

0.0 

Manyears; 

10.2 

Lt 

KH 

LtCol 

Col 

1  4Txx  1  Systems  Engineering  j 

_ 0| 

ptimal  Graduating  Class  Structure  | 

1  MS: 

5.6 

■EBH 

1.9 

0.0 

0.0 

0.0 

PhD: 

0.3 

0.0 

0.2 

0.1 

0.0 

0.0 

9.2 

Lt 

■23:91 

wtmm 

LtCol 

Col 
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Formulation  Worksheet  (Partial) 


Quota  Allocation  Model:  This  Solution  Strictly  Enforces  Grade  Requirements. 


lOptimum:  peryearl 

optimal  Graduating  Class  Structu 

re 

1  MS: 

0.00 

0.00 

0.00 

0.00 

lEESHI 

10.44 

0.00 

0.00 

0.00 

Capt 

KEH 

mSEM 

Col 

***  THIS  WORKSHEET  IS  USED  IN  CONJUNCTION  WITH  THE  MASTER  PROGRAM*^ 
***  THERE  ARE  NO  CELLS  THAT  CAN  BE  CHANGED  IN  THIS  WORKSHEET*** 


ttrition  Factor: 


Inventory  Factors:  I  BS: 


Variables: 


number  of  officers  with  \  years  of  service  and  k  years  of  graduate  education  (  no  action  taken) 
’  -  number  of  officers  with  I  years  of  service  and  k  years  of  graduate  education  (sent  to  school) 


arameters: 


Attrition  (a)  -  attrition  probability  for  officers  with  i  years  of  service  and  degree  level  d  (a  ranges  from  0  to  1). 
Requirements  (FQ  -  requirement  (number  of  authorized  positions)  for  officers  with  degree  level  d  and  grade  g. 
Inventory  Factor  (f)  -  inventory  factor  for  degree  level  d  (desired  ratio  of  Inventory  to  authorized  positions). 


This  is  the  LP  formulation  area: 


69 


APPENDIX  C:  VISUAL  BASIC  for  APPLICATIONS  CODE 


SubRunO 
'  Run  Macro 

'This  MACRO  will  evaluate  each  of  the  ASCs  and  update  the 
'information  on  the  master  worksheet. 

Dim  i  As  Integer 
i  =  93 

Sheets("Worksheet").  Select 
Range("C12").Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 
Range("D13").Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 
Range("D  1 4").  Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 
Range("F  14").  Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 
Range("H14").Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 
While  i  <=  243 
Sheets("Worksheet").  Select 
Cells(51, 1)  =  Cells(i  -  2,  8) 

Cells(53,  2)  =  Cells(i,  9) 

Cells(54,  2)  =  Cells(i  +1,9) 

Cells(55, 2)  =  Cells(i  +  2,  9) 

Cells(53,  3)  =  Cells(i,  10) 

Cells(54,  3)  =  Cells(i  +  1,  10) 

Cells(55,  3)  =  Cells(i  +  2, 10) 

Cells(53, 4)  =  Cells(i,  11) 

Cells(54, 4)  =  Cells(i  +  1, 11) 

Cells(55, 4)  =  Cells(i  +  2,  11) 

Cells(53,  5)  =  Cells(i,  12) 

Cells(54,  5)  =  CellsO  +  1, 12) 

Cells(55,  5)  =  Cells(i  +  2, 12) 

Cells(53,  6)  =  Cells(i,  13) 

Cells(54, 6)  =  CellsO  +1,13) 

Cells(55,  6)  =  CellsO +  2, 13) 

Range("G56").  Select 
Application.Run  "QModel2.xls!  Solver" 

Cells(i,  2)  =  Cells(4, 2) 

CellsO +  1, 2)  =  Cells(5, 2) 

Cells(i  +  2,  2)  =  Cells(6, 2) 

CellsO,  3)  =  Cells(4,  3) 
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Cells(i+l,3)  =  Cells(5, 3) 

Cells(i,  4)  =  Cells(4,  4) 

Cells(i+l,4)  =  Cells(5, 4) 

Cells(i,  5)  =  Cells(4,  5) 

Cells(i  +  1,  5)  =  Cells(5,  5) 

Cells(i,6)  =  Cells(4,6) 

Cells(i  +1,6)  =  Cells(5,  6) 

Cells(i,  7)  =  Cells(4,  7) 

Cells(i+l,7)  =  Cells(5,  7) 

i  =  i  +  6 

Wend 

Sheets("Master").  Select 
Cells(13,  l),Select 

End  Sub 

Sub  SolverO 
'  Solver  Macro 

'This  MACRO  calls  the  Solver  and  accepts  the  values. 

SolverOk  SetCell:="$B$6",  MaxMinVal:=2,  ValueOf;="0",  ByChange;=  _ 
"$B$39:  $Y$39,$B$40:  $W$40,$C$4 1 :  $X$4 1  ,$D$42:  $Y$42,$D$43 :  $V$43,$E 
$44;  $W$44,$F$45 :  $X$45,$G$46:  $Y$46" 

SolverSolve  UserFinish:=True 
End  Sub 

Sub  ElectricalEngO 

'  ElectricalEng  Macro 

'This  MACRO  will  evaluate  the  4Ixx  ASC. 

Sheets("Individual").  Select 
Range("C12").Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 

Range("D  13").  Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 

Range("D14").Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 

Range("F  14").  Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 

Range("H14").Select 

ActiveCell.FormulaRlCl  =  "=Master!R[-8]C" 

Range("A51").  Select 

ActiveCell.FormulaRlCl  =  "=Requirements!R[-21]C" 

Range("B53").  Select 

ActiveCell.FormulaRlCl  =  "=PRODUCT(R56C2,Requirements!R[-21]C)" 
Range("B53").  Select 

Selection.  AutoFill  Destination:=Range("B53  :B55 "),  Type:=xlFillDefault 
Range("B53;B55").Select 
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Range("B53 ").  Select 

Selection.  AutoFill  Destination:=Range("B53:F53"),  Type:=xlFillDefault 
Range("B53:F53").  Select 
Range("B54").  Select 

Selection.  AutoFill  Destination:=Range("B54:F54"),  Type:=xlFillDefault 
Range("B54:F54").  Select 
Range("B5  5 ").  Select 

Selection.  AutoFill  Destination:  =Range("B 5  5 :  F55 "),  Type:  =xlFillDefault 

Range("B55:F55").Select 

Range("G56").  Select 

Application.  Run  ''QModel2.xls!  Solver" 

Sheets("Master").  Select 
Cells(31,  l).Select 

End  Sub 

Sub  ExperimentO 

'This  MACRO  runs  the  full  factorial  experiment  on  whatever 
'individual  worksheet  that  is  called.  The  individual  ASC 
'must  first  be  run. 

Dim  i  As  Integer 
i  =  95 

Sheets("Individual").  Select 
While  i  <=  126 

Cells(12,  3)  =  Cells(i,  10) 

Cells(13, 4)  =  CellsO,  11) 

Cells(14, 4)  =  Cells(i,  12) 

Cells(14,  6)  =  Cells(i,  13) 

Cells(14,  8)  =  Cells(i,  14) 

Cells(56,  7).  Select 

Application. Run  " 'QModel2 . xl s' !  Solver" 

Cells(i,  15)  -  Cells(4, 2) 

Cells(i,  16)  =  Cells(5, 2) 

Cells(i,  17)  =  Cells(6, 2) 

Cells(i,  6)  =  Cells(i,  15) 

CellsO,  7)  =  CellsO,  16) 

CellsO,  8)  =  CellsO,  17) 

i  =  i+  1 

Wend 

Cells(126,  8).Select 

End  Sub 
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APPENDIX  D;  SENSITIVITY  ANALYSIS  RESULTS 


INPUT  PARAMETERS 


***1  Denotes  Significant*** 


BS 

0 

IH^I 

H3ii 

HEB 

BU 

MS 

mm 

60 

68 

93 

77 

118 

70 

66 

118 

80 

19 

PhD 

mm 

^EH 

1 

2 

2 

2 

4 

1 

4 

1 

Total 

-4n 

l37J 

60 

68 

93 

78 

120 

72 

68 

122 

21 

84 

20 

Ratio 

K£ll 

|j2i£] 

0.03 

0.05 

121^1 

M-Y 

1AMJ 

OYRY 

1AMH 

1AUY 

1ATY 

1ASY 

OYSY 

4Txx 

1AMY 

1AMS 

1ASA 

1ASM 

a 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

R 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

fO 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

mm 

f1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

f2 

0 

0 

0 

0 

0 

1 

1 

1 

1 

1 

1 

1 

1 

MS 

1AMJ 

OYRY 

1AMH 

1AUY 

1ATY 

1ASY 

>- 

O 

4Txx 

1AMY 

1AMS 

1ASA 

1ASM 

a 

”T” 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

WEm 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

fO 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

fi 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

f2 

0 

Hi 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

PhD 

1AMJ 

OYRY 

1AMH 

1AUY 

1ATY 

1ASY 

OYSY 

4Txx 

1AMY 

1AMS 

1ASA 

a 

”5” 
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Figure  26:  Parameter  Analysis  (Part  1) 
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Figure  27:  Parameter  Analysis  (Part  2) 
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OYEY 


This  is  the  Full-Factorial  experiment  for  the  OYEY  Ed  Code. 
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Figure  28:  OYEY  Factorial  Experiment 
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Figure  29:  OYEY  Summary  Output  /  ANOVA 
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lAGE 


This  is  the  Full-Factoriai  experiment  for  the  1  AGE  Ed  Code. 
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Figure  30:  lAGE  Factorial  Experiment 


77 


SUMMARY  OUTPUT  MAN-YEARS 

Regression  Statistics 

Multiple  R 

0.9962 

R  Square 

0.9924 

Adjusted  R  Square 

0.9913 

Standard  Error 

0.6602 

Observations 

32.0000 

lANOVA 


df 

SS 

MS 

F 

Regression 

4 

1545.5589 

386.3897 

886.3652 

0.0000 

Residual 

27 

11.7700 

0.4359 

Total 

31 

1557.3290 

Coefficients 

standard  Error 

f  Sfaf 

P-vaiue 

Intercept 

34.4894 

0.1167 

295.4981 

0.0000 

a 

0.3107 

0.1167 

2.6619 

0.0129 

R 

3.4489 

0.1167 

29.5498 

0.0000 

f1 

5.9506 

0.1167 

50.9834 

0.0000 

f2 

0.9473 

0.1167 

8.1162 

0.0000 

SUMMARY  OUTPUT  MS  QUOTA 

Regression  Statistics 

Multiple  R 

0.9961 

R  Square 

0.9921 

Adjusted  R  Square 

0.9910 

Standard  Error 

0.4354 

Observations 

32.0000 

lANOVA  I 

df 

SS 

MS 

F 

Significance  F 

Regression 

4 

645.9824 

161.4956 

852.0751 

0.0000 

Residual 

27 

5.1174 

0.1895 

Total 

31 

651.0997 

Coefficients 

Standard  Error 

tStat 

P-value 

Intercept 

20.8879 

271.4112 

0.0000 

a 

0.2049 

0.0770 

2.6628 

0.0129 

R 

2.0888 

0.0770 

27.1411 

0.0000 

f1 

3.9671 

0.0770 

51.5469 

0.0000 

f2 

0.2105 

0.0770 

'  2.7353 

0.0109 

SUMMARY  OUTPUT  PHD  QUOTA 

Regression  Statistics 

Multiple  R 

0.9960 

R  Square 

0.9920 

Adjusted  R  Square 

0.9915 

standard  Error 

0.0221 

Observations 

32.0000 

lANOVA 

df  SS  MS 


Regression 

2 

1.7726 

0.8863 

1807.3259 

0.0000 

Residual 

29 

0.0142 

0.0005 

Total 

31 

1.7868 

1  Coefficients 

standard  Error  t  Stat 

P-value 

Intercept 

1 

.0525 

0.0 

03 

9 

268.8736 

0.0000 

R 

D 

.1053 

0.0 

9 

26.8874 

0.0000 

f2 

.2105 

0.0 

9 

53.7747 

0.0000 

Figure  31:  lAGE  Summary  Output  /ANOVA 
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4Ixx 


This  is  the  Fuli-Factorial  experiment  for  the  4ixx  Ed  Code. 
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Figure  32:  4Ixx  Factorial  Experiment 
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Figure  33:  4Ixx  Summary  Output  /  ANOVA 
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Figure  35:  4Ixx  Cost  Analysis  Summary  Output  /ANOVA 
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Figure  37:  lAGE  Cost  Analysis  Summary  Output  /  ANOVA 
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